-- Logs begin at Wed 2022-11-02 06:46:07 UTC, end at Wed 2022-11-02 07:47:26 UTC. -- Nov 02 07:20:51.881253 dv-cinder-804735-33-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 07:20:51.889446 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 07:20:51.891970 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 07:20:51 2022] *** Nov 02 07:20:51.891970 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 07:20:51.891970 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 07:20:51.891970 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: nodename: dv-cinder-804735-33-iscsi Nov 02 07:20:51.891970 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: machine: x86_64 Nov 02 07:20:51.891970 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: clock source: unix Nov 02 07:20:51.891970 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: pcre jit disabled Nov 02 07:20:51.891970 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: detected number of CPU cores: 4 Nov 02 07:20:51.891970 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: current working directory: / Nov 02 07:20:51.891970 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: detected binary path: /usr/bin/uwsgi-core Nov 02 07:20:51.891970 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: your processes number limit is 47680 Nov 02 07:20:51.892589 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: your memory page size is 4096 bytes Nov 02 07:20:51.892589 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: detected max file descriptor number: 2048 Nov 02 07:20:51.892589 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: lock engine: pthread robust mutexes Nov 02 07:20:51.892589 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: thunder lock: enabled Nov 02 07:20:51.892589 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 07:20:51.892589 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 07:20:51.931715 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: Python main interpreter initialized at 0x55faa1e789c0 Nov 02 07:20:51.931715 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: python threads support enabled Nov 02 07:20:51.931715 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: your server socket listen backlog is limited to 100 connections Nov 02 07:20:51.931715 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: your mercy for graceful operations on workers is 90 seconds Nov 02 07:20:51.932061 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 07:20:51.932061 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: *** Operational MODE: preforking *** Nov 02 07:20:51.932344 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: *** uWSGI is running in multiple interpreter mode *** Nov 02 07:20:51.932344 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: spawned uWSGI master process (pid: 103783) Nov 02 07:20:51.935182 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: spawned uWSGI worker 1 (pid: 103784, cores: 1) Nov 02 07:20:51.935182 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: spawned uWSGI worker 2 (pid: 103785, cores: 1) Nov 02 07:20:51.935182 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 07:20:51.932547 dv-cinder-804735-33-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 02 07:20:52.585771 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 07:20:52.612730 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 07:20:53.653799 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:20:53.653799 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: from cryptography.utils import int_from_bytes Nov 02 07:20:53.654281 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:20:53.654281 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: from cryptography.utils import int_from_bytes Nov 02 07:20:53.656373 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:20:53.656373 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: from cryptography.utils import int_from_bytes Nov 02 07:20:53.656797 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:20:53.656797 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: from cryptography.utils import int_from_bytes Nov 02 07:20:56.128254 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 07:20:56.128865 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 07:20:56.128973 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 07:20:56.129332 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 07:20:56.129431 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 07:20:56.129519 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 07:20:56.129599 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 07:20:56.129712 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 07:20:56.129962 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.130065 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 07:20:56.130315 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.130445 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 07:20:56.130740 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.130842 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.131059 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.131155 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.131372 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.131467 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.131681 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.131769 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.131996 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.132081 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.132297 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.132381 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.132610 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.132694 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.132864 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.132949 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.133172 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.133256 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.133466 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.133549 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-33-iscsi {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.133772 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.133858 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.134089 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.134188 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-33-iscsi {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.134415 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.134533 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.134718 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.134803 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.135015 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.135106 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.135329 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.135427 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.135629 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.135713 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.135939 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.136132 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.136529 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.136657 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.136763 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.136880 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.137016 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.137129 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.137314 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.137454 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.137616 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.137764 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.137941 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.138066 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.138249 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.138402 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.138579 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.138705 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.138892 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.138991 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.139194 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.139289 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.139508 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.139661 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-33-iscsi {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.139809 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.139971 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.140194 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-33-iscsi {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.140302 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.140500 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.140586 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.140806 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.140954 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.141109 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.141252 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.141508 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.141596 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.141810 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.141905 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.142110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.142203 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.142447 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.142537 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.142766 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.142868 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.143066 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.143151 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.143376 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.143462 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.143964 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.144056 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.144263 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.144356 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.144565 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.144653 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.144860 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.144946 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.145168 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.145263 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.145463 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.145546 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.145760 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.146414 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.146690 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.146777 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.146992 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.147086 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.147238 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.147330 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.147541 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.147626 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.147859 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.148001 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.148175 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.148261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.148420 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.148505 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.148725 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.148817 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.148971 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.149057 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.149283 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.149368 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.149598 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.149698 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.149900 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.149985 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.150213 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.150348 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.150522 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.150608 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.150821 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.150907 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.151116 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.151295 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.151413 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.151497 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.151708 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.151806 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.152006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.152103 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.152316 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.152400 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.152614 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.152700 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.152923 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.153015 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.153221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.153307 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.153531 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.153623 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.153831 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.153922 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.154153 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.154237 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.154481 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.154570 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.154788 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.154887 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.155099 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.155185 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.155401 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.155484 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.155698 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.155782 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.155997 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.156082 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.156293 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.156377 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.156589 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.156674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.156885 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.156970 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.157197 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.157282 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.157438 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.157523 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.157731 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.157817 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.158027 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.158121 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.158317 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.158415 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.158637 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.158721 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.158932 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.159033 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.159228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.159313 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.159519 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.159613 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.159814 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.159906 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.160106 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.160196 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.160399 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.160482 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.160693 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.160790 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.160987 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.161072 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.161281 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.161365 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.162121 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.162221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.162436 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.162525 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.162734 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.162818 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.163028 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.163114 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.163326 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.163422 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.163622 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.163707 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.163921 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.164006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.164218 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.164318 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.164515 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.164607 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.164811 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.164899 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.165108 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.165206 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.165404 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.165489 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.165702 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.165788 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.166004 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.166088 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.166302 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.166439 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.166627 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.166715 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.166923 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.167014 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.167221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.167315 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.167516 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.167608 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.167817 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.167900 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.168107 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.168190 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.168404 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.168491 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.168695 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.168779 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.168991 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.169089 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.169284 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.169368 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.169579 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.169665 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.169872 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.169966 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.170165 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.170249 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.170481 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.170583 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.170777 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.170872 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.171069 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.171155 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.171360 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.171443 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.171651 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.171744 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.171943 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.172035 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.172253 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.172338 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.172550 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.172636 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.172849 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.172934 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.173144 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.173230 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.173441 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.173533 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.173750 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:20:56.173837 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.174076 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.174161 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.174415 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.174502 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.174752 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.174837 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.175061 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.175150 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.175376 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.175476 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.175685 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.175770 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.175992 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.176088 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.176295 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.176379 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.176600 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.176698 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.176903 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.176996 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.177232 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.177325 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.177614 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.177713 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.177841 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.178020 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.178150 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.178238 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.178482 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.178570 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.178792 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.178892 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.179100 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.179185 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.179401 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.179493 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.179707 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.179809 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.180011 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.180097 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.180317 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.180411 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.180620 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.180718 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.180935 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.181020 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.181240 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.181325 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.181569 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.181655 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.181887 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.181972 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.182199 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.182285 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.182529 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.182628 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.182833 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.182919 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.183134 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.183220 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.183436 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.183531 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.183740 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.183826 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.184056 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.184147 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.184367 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.184459 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.184673 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.184758 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.184985 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.185078 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.185287 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.185380 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.185593 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.185679 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.185897 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.185991 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.186200 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.186284 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.186528 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.186615 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.186832 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.186929 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.187139 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.187236 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.187453 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.187539 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.187762 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.187857 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.188067 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.188152 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.188373 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.188467 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.188676 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.188760 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.188977 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.189062 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.189279 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.189364 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.189575 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.189668 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.189874 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.189962 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.190173 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.190258 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.190496 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.190587 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.190797 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.190885 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.191097 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.191180 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.191397 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.191484 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.191700 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.191784 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.192016 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.192107 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.192315 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.192401 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.192616 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.192734 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.192980 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.193174 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.193296 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.193390 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.193623 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.193708 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.193929 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.194024 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.194232 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.194318 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.194568 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.194665 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.194872 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.194966 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.195173 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.195266 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.195470 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.195554 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.195783 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.195883 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.196078 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.196162 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.196377 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.196462 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.196679 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.196765 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.196981 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.197066 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.197284 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.197371 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.197587 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.197672 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.197886 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.197971 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.198187 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.198271 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.198512 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.198612 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.198865 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.198961 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.199122 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.199216 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.199427 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.199512 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.199728 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.199819 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.200045 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.200208 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.200343 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.200428 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.200658 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.200742 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.200957 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.201050 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.201259 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.201345 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.201555 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.201638 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.201851 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.201943 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.202145 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.202230 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.202467 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.202601 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.202766 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.202864 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.203061 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.203158 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.203357 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.203441 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.203653 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.203738 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.203946 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.204030 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.204245 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.204340 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.204544 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.204639 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.204840 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.204924 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.205137 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.205224 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.205433 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.205519 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.205726 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.205811 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.206020 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.206106 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.206354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.206499 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.206678 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.206765 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.207003 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.207100 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.207321 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.207418 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.207625 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.207711 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.207932 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.208026 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.208234 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.208848 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.209077 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.209163 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.209387 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.209502 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.209689 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.209775 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.210004 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.210090 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.210308 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.210429 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.210648 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.210734 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.210952 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.211038 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.211263 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.211348 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.211565 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.211649 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.211877 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.211964 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.212179 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.212264 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.212484 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.212569 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.212784 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.212875 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.213093 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.213186 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.213418 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.213509 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.213734 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.213820 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.214037 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.214130 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.214343 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.214487 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.214667 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.214754 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.214970 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.215056 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.215272 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.215357 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.215572 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.215670 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.215875 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.215968 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.216173 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.216257 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.216481 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.216573 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.216783 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.216875 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.217088 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.217179 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.217387 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.217489 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.217696 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.217787 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.217993 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.218078 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.218296 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.218440 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.218619 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.218711 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.218928 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.219013 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.219241 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.219325 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.219543 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.219635 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.219850 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.219934 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.220153 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.220238 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.220455 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.220540 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.220756 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.220840 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.221053 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.221139 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.221352 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.221436 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.221646 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.221731 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.221947 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.222043 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.222245 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.222330 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.222570 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.222671 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.222869 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.222959 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.223171 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.223255 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.223471 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.223564 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.223767 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.223852 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.224638 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.224823 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.224938 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.225155 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.225239 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.225469 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.225563 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.225782 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.225868 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.226103 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.226190 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.226447 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.226537 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.226754 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.226840 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.227052 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.227138 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.227353 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.227487 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.227663 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.227758 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.227964 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.228048 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.228262 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.228348 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.228557 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.228651 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.228852 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.228937 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.229187 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.229275 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.229486 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.229652 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.229783 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.229868 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.230092 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.230178 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.230412 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.230513 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.230724 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.230818 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.231028 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.231161 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.231330 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.231424 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.231634 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.231727 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.231940 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.232024 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.232244 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.232330 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.232544 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.232629 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.232846 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.232930 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.233149 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.233235 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.233450 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.233784 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.234010 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.234095 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.234311 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.234417 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.234645 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.234730 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.234948 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.235044 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.235246 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.235332 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.235546 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.235631 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.235849 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.235944 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.236160 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.236404 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.236715 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.236814 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.237024 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.237121 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.237335 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.237419 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.237647 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.237740 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.237964 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.238059 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.238283 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.238434 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.238629 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.238715 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.238938 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.239024 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.239238 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.239346 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.239554 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.239643 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.239887 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.239991 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.240240 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.240373 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.240548 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.240634 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.240849 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.240935 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.241148 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.241242 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.241446 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.241531 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.241745 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.241829 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.242045 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.242131 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.242341 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.242445 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.242661 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.242758 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.242958 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.243044 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.243256 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.243350 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.243553 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.243638 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.243849 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.243935 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.244148 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.244232 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.244444 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.244528 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.244762 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.244848 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.245059 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.245152 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.245355 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.245451 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.245650 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.245737 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.245946 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.246038 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.246268 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.246414 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.246590 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.246676 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.246921 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.247019 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.247244 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.247344 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.247581 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.247712 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.247884 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.247977 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.248187 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.248274 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.248484 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.248568 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.248782 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.248875 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.249080 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.249165 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.249378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.249466 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.249678 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.249762 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.249975 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.250068 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.250270 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.250374 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.250595 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.250679 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.250895 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.250980 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.251192 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.251321 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.251488 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.251584 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.251782 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.251867 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.252077 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.252162 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.252374 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.252467 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.252674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.252759 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.252970 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.253098 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.253265 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.253427 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.253561 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.253646 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.253860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.253943 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.254155 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.254249 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.254471 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.254571 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.254770 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.254855 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.255067 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.255179 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.255394 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.255480 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.255693 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.255850 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.255992 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.256294 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.256429 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.256593 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.256736 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.256890 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.257045 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.257205 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.257349 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.257508 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.257650 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.257808 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.257971 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.258105 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.258276 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.258430 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.258601 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.258732 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.258900 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.259027 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.259203 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.259330 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.259503 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.259648 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.259799 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.259958 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.260103 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.260256 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.260421 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.260560 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.260730 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.260858 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.261027 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.261157 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.261330 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.261472 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.261627 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.261745 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.261925 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.262044 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.262226 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.262341 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.262548 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.262659 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.262847 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.262960 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.263143 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.263259 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.263438 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.263578 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.263736 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.263883 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.264032 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.264179 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.264351 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.264482 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.264656 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.264779 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.264955 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.265116 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.265256 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.265414 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.265552 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.265769 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.265886 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.266074 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.266182 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.266407 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.266571 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.266722 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.266877 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.267027 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.267186 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.267331 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.267498 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.267638 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.267802 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.267926 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.268106 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.268233 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.268413 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.268538 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.268712 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.268844 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.269021 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.269142 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.269327 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.269421 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.269635 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.269727 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.269934 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.270020 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.270230 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.270316 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.270568 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.270691 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.271475 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.271569 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.271807 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.271900 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.272215 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.272301 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.272539 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.272624 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.272860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.272952 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.273161 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.273283 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.273468 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.273553 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.273772 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.273857 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.274072 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.274156 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.274392 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.274492 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.274701 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.274786 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.275003 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.275086 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.275305 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.275397 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.275603 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.275691 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.275905 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.275998 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.276206 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.276299 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.276502 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.276586 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.276804 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.276888 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.277108 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.277202 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.277403 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.277487 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.277705 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.277795 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.278002 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.278098 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.278299 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.278397 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.278623 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.278719 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.278991 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.279082 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.279295 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.279381 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.279594 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.279678 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.279920 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.280005 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.280226 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.280311 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.280530 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.280623 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.280840 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.280926 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.281149 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.281234 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.281448 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.281542 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.281757 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.281842 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.282069 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.282154 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.282507 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.282677 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.282760 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.282837 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.283036 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.283130 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.283333 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.283428 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.283638 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.283724 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.283951 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.284036 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.284251 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.284343 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.284550 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.284635 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.284847 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.284939 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.285153 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.285237 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.285447 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.285539 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.285743 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.285835 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.286059 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.286146 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.286369 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.287069 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.287325 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.287576 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.287737 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.287988 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.288115 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.288295 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.288390 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.288600 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.288723 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.288919 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.289025 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.289238 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.289326 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.289558 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.289652 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.289858 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.289958 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.290166 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.290253 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.290495 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.290598 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.290816 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.290956 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.291132 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.291217 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.291433 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.291525 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.291740 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.291827 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.292036 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.292122 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.292341 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.292426 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.292641 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.292729 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.292946 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.293038 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.293261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.293348 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.293566 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.293653 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.293883 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.293969 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.294257 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.294350 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.294605 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.294691 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.294906 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.294990 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.295211 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.295308 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.295511 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.295598 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.295815 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.295902 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.296112 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.296205 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.296406 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.296491 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.296701 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.296786 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.296999 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.297093 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.297302 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.297386 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.297605 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.297691 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.297906 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.297992 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.298205 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.298290 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.298524 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.298613 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.298823 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.298909 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.299121 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.299213 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.299437 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.299522 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.299733 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.299819 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.300051 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.300136 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.300356 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.300441 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.300655 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.300740 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.300972 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.301058 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.301270 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.301368 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.301567 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.301651 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.301865 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.301951 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.302201 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.302296 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.302523 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.302611 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.302822 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.302908 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.303149 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.303243 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.303446 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.303538 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.303762 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.303855 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.304073 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.304167 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.304392 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.304485 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.304698 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.304784 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.305011 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.305105 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.305316 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.305402 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.305625 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.305711 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.305927 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.306014 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.306227 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.306319 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.306552 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.306651 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.306852 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.306938 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.307145 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.307237 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.307443 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.307536 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.307736 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.307828 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.308033 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.308118 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.308329 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.308430 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.308621 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.308717 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.308915 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.308999 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.309209 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.309304 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.309504 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.309590 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.309816 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.309908 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.310112 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.310211 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.310449 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.310539 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.310754 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.310839 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.311051 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.311150 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.311351 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.311437 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.311645 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.311731 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.311974 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.312060 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.312269 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.312354 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.312583 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.312668 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.312883 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.312969 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.313186 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.313271 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.313493 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.313579 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.313797 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.313883 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.314101 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.314186 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.314425 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.314524 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.314736 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.314822 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.315039 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.315127 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.315344 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.315439 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.315647 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.315740 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.315955 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.316049 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.316261 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.316471 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.316559 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.316793 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.317075 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.317161 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.317392 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.317489 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.317745 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.317997 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.318095 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.318168 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.318422 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.318537 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.318668 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.318754 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.318976 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.319073 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.319284 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.319370 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.319589 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.319684 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.319893 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.319979 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.320198 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.320285 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.320515 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.320607 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.320828 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.320927 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.321176 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.321274 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.321440 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.321528 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.321746 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.321953 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.322056 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.322137 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.322383 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.322471 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.322690 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.322778 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.323013 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.323104 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.323318 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.323410 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.323624 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.323736 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.323930 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.324016 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.324233 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.324326 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.324537 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.324629 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.324843 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.324935 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.325146 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.325246 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.325447 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.325547 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.325750 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.325850 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.326052 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.326173 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.326347 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.326475 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.326681 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.326773 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.326987 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.327088 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.327302 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.327401 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.327607 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.327707 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.327913 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.328013 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.328217 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.328315 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.328561 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.328723 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.328821 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.329033 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.329326 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.329419 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.329638 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.329730 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.329965 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.330066 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.330275 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.330393 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.330609 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.330703 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.330917 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.331016 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.331289 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.331385 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.331514 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.331610 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.331819 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.331914 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.332119 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.332219 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.332412 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.332518 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.332714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.332809 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.333012 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.333110 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.333838 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.333947 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.334144 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.334237 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.334461 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.334564 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.334777 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.334986 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.335079 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.335322 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.335596 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.335689 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.335931 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.336030 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.336239 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.336338 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.336545 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.336635 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.336846 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.336939 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.337160 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.337250 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.337458 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.337548 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.337758 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.337850 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.338057 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.338148 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.338404 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.338510 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.338677 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.338767 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.339034 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.339125 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.339304 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.339399 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.339575 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.339661 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.339847 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.339939 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.340147 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.340246 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.340431 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.340520 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.340736 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.340835 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.341033 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.341135 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.341402 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.341498 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.341673 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.341760 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.341931 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.342028 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.342207 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.342295 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.342543 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.342638 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.342841 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.342932 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.343138 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.343237 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.343435 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.343525 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.343731 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.343822 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.344031 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.344123 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.344327 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.344424 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.344620 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.344709 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.344920 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.345011 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.345229 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.345322 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.345538 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.345638 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.345852 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.345945 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.346150 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.346251 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.346493 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.346587 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.346773 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.346864 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.347073 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.347177 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.347382 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.347474 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.347682 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.347773 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.347985 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.348087 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.348287 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.348378 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.348590 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.348683 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.348983 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.349697 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.349799 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.350029 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.350270 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.350513 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.350712 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.350810 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.350981 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.351067 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.351264 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.351352 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.351694 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.351789 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.351859 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.351925 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.352167 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.352254 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.352436 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.352523 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.352747 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.352840 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.353048 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.353148 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.353349 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.353441 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.353649 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.353747 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.353950 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.354049 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.354249 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.354340 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.354573 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.354664 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.354873 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.354977 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.355174 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.355330 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.355476 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.355621 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.355774 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.355920 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.356073 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.356226 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.356377 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.356523 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.356687 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.356831 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.356977 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.357130 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.357282 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.357429 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.357583 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.357729 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.357874 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.358018 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.358163 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.358307 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.358499 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.358989 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.359144 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.359297 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.359444 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.359599 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.359763 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.359918 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.360064 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.360209 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.360396 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.360553 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.360703 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.360859 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.361004 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.361151 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.361296 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.361296 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.361608 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.361826 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.362004 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.362153 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.362308 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.362492 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.362704 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.362882 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.363030 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.363175 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.363329 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.363482 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.363629 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.363775 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.363920 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.364065 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.364219 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.364365 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.364511 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.364761 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.365033 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.365196 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.365369 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.365516 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.365661 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.365813 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.365960 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.366114 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.366268 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.366475 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.366626 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.366771 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.366929 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.367087 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.367234 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.367418 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.367565 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.367710 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.367864 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.368018 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.368164 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.368309 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.368454 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.368599 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.368757 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.368915 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.369147 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.369300 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.369446 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.369592 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.369747 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.369893 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.370040 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.370185 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.370331 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.370501 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.370665 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.370821 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.370978 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.371124 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.371268 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.371422 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.371568 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.371713 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.371940 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.372095 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.372241 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.372396 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.372544 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.372689 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.372842 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.373024 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.373178 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.373332 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.373479 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.373624 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.373769 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.373914 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.374058 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.374213 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.374380 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.374521 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.374606 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.374680 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.374766 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.374848 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.374927 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.375005 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.375083 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.375083 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.375243 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.375324 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.375402 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.375479 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.375556 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.375764 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.375906 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.376078 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.376250 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.376386 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.376607 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.376713 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.376957 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.377047 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.377290 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.377379 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.377593 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.377688 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.377900 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.377988 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.378204 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.378336 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.378530 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.378634 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.378835 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.378923 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.379160 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.379380 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.379499 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.379725 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.379847 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.380045 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.380154 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.380391 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.380489 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.380702 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.380836 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.381142 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.381239 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.381450 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.381547 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.381773 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.381862 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.382079 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.382187 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.382404 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.382533 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.382711 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.382890 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.382995 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.383304 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.383408 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.383612 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.383707 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.383912 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.384013 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.384214 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.384328 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.384521 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.384615 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.384828 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.384922 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.385145 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.385248 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.385470 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.385564 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.385773 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.385868 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.386094 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.386189 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.386437 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.386533 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.386777 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.386872 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.387081 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.387175 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.387415 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.387512 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.387741 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.387835 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.388049 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.388150 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.388354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.388480 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.388652 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.388803 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.388902 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 07:20:56.389118 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.389454 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:20:56.389698 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 07:20:56.541782 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO dbcounter [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] Registered counter for database nova_api Nov 02 07:20:56.543818 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO dbcounter [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] Registered counter for database nova_api Nov 02 07:20:56.563330 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG oslo_db.sqlalchemy.engines [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103784) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:20:56.565028 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_db.sqlalchemy.engines [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103785) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:20:56.570736 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writer thread running {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:20:56.572121 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG dbcounter [-] [103785] Writer thread running {{(pid=103785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:20:56.626645 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.context [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a592cbfe-d5e4-461b-8a54-ba6eff3d281b(cell1) {{(pid=103784) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 07:20:56.628183 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.context [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a592cbfe-d5e4-461b-8a54-ba6eff3d281b(cell1) {{(pid=103785) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 07:20:56.631064 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:20:56.631503 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:20:56.633556 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:20:56.633729 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:20:56.634024 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:20:56.634460 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:20:56.634902 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:20:56.635647 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:20:56.636361 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:20:56.636801 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:20:56.636898 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:20:56.638834 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:20:56.638926 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO dbcounter [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] Registered counter for database nova_cell0 Nov 02 07:20:56.640838 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO dbcounter [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] Registered counter for database nova_cell0 Nov 02 07:20:56.643012 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO dbcounter [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] Registered counter for database nova_cell1 Nov 02 07:20:56.645180 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO dbcounter [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] Registered counter for database nova_cell1 Nov 02 07:20:56.652847 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG oslo_db.sqlalchemy.engines [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103784) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:20:56.653607 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG oslo_db.sqlalchemy.engines [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103784) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:20:56.655984 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_db.sqlalchemy.engines [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103785) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:20:56.657312 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_db.sqlalchemy.engines [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103785) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:20:56.660474 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writer thread running {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:20:56.661962 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writer thread running {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:20:56.663943 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG dbcounter [-] [103785] Writer thread running {{(pid=103785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:20:56.665409 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG dbcounter [-] [103785] Writer thread running {{(pid=103785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:20:56.804147 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO dbcounter [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] Registered counter for database nova_cell0 Nov 02 07:20:56.808674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO dbcounter [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] Registered counter for database nova_cell0 Nov 02 07:20:56.813069 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG oslo_db.sqlalchemy.engines [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103784) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:20:56.817359 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_db.sqlalchemy.engines [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103785) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:20:56.819416 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writer thread running {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:20:56.823021 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG dbcounter [-] [103785] Writer thread running {{(pid=103785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:20:57.156085 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: WARNING keystonemiddleware.auth_token [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 07:20:57.163349 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: WARNING keystonemiddleware.auth_token [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 07:20:57.173409 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: WARNING keystonemiddleware.auth_token [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 07:20:57.182505 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: WARNING keystonemiddleware.auth_token [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 07:20:57.501583 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: WARNING keystonemiddleware.auth_token [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 07:20:57.508224 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: WARNING keystonemiddleware.auth_token [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 07:20:57.513504 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55faa1e789c0 pid: 103785 (default app) Nov 02 07:20:57.515568 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:20:57.516884 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001860 Nov 02 07:20:57.517272 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Wed Nov 2 07:20:57 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:20:57.538327 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: WARNING keystonemiddleware.auth_token [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 07:20:57.544343 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: WARNING keystonemiddleware.auth_token [None req-561e2b2d-15ca-46db-8c23-2f1092594388 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 07:20:57.549637 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55faa1e789c0 pid: 103784 (default app) Nov 02 07:22:19.310094 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:22:19.311134 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Nov 02 07:22:19.311796 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 07:22:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:22:19.324348 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_api:SELECT=3 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:19.325145 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_cell0:SELECT=3 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:19.325852 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_cell1:SELECT=3 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:19.327057 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:20.196330 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-68af1adb-07ed-401d-b530-e64a316c253b admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:22:20.230049 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-68af1adb-07ed-401d-b530-e64a316c253b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.911473 Nov 02 07:22:20.230815 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Nov 2 07:22:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:22.842597 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:22:22.843615 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-46a78b8d-a6c7-452e-b38c-7362f430cf55 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Nov 02 07:22:22.844324 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 07:22:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:22:23.299939 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-4d35912a-3ff6-4aab-a141-1745ae8c3fa5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "name": "cirros256"}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:23.347135 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-4d35912a-3ff6-4aab-a141-1745ae8c3fa5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496819 Nov 02 07:22:23.347872 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 07:22:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:22:23.361619 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG dbcounter [-] [103785] Writing DB stats nova_api:SELECT=3 {{(pid=103785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:23.363879 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG dbcounter [-] [103785] Writing DB stats nova_cell1:SELECT=3 {{(pid=103785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:23.364612 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG dbcounter [-] [103785] Writing DB stats nova_cell0:SELECT=3 {{(pid=103785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:23.365329 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG dbcounter [-] [103785] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:23.572037 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-1a365721-9adb-4185-8a26-537f3d4a90c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:23.639885 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-1a365721-9adb-4185-8a26-537f3d4a90c2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283396 Nov 02 07:22:23.640654 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Nov 2 07:22:23 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:26.230110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-4d35912a-3ff6-4aab-a141-1745ae8c3fa5 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:22:26.231089 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-4d35912a-3ff6-4aab-a141-1745ae8c3fa5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Nov 02 07:22:26.231481 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 07:22:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:22:26.870877 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-c3663a6a-297b-4ff2-bd94-780582ea5a17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "id": "d1", "swap": 0, "disk": 5, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:26.909964 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-c3663a6a-297b-4ff2-bd94-780582ea5a17 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.672202 Nov 02 07:22:26.910869 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 07:22:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:22:26.923677 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-0d5e880b-a103-4492-83d4-8458c68254ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:26.963643 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-0d5e880b-a103-4492-83d4-8458c68254ab admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043578 Nov 02 07:22:26.964243 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Nov 2 07:22:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:29.554084 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-c3663a6a-297b-4ff2-bd94-780582ea5a17 admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:22:29.555145 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-c3663a6a-297b-4ff2-bd94-780582ea5a17 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Nov 02 07:22:29.555606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 07:22:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:22:29.984085 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-b06a1a1e-9021-4e5e-909c-4c3efb73cff0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 10, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "swap": 0, "ram": 1024}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:30.006178 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-b06a1a1e-9021-4e5e-909c-4c3efb73cff0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444112 Nov 02 07:22:30.006502 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 07:22:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:22:30.018733 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-7af180c3-a645-4324-a39e-4bc060221c81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:30.047749 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-7af180c3-a645-4324-a39e-4bc060221c81 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032562 Nov 02 07:22:30.048336 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Nov 2 07:22:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:32.689199 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-b06a1a1e-9021-4e5e-909c-4c3efb73cff0 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:22:32.690221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-b06a1a1e-9021-4e5e-909c-4c3efb73cff0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Nov 02 07:22:32.690664 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 07:22:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:22:33.107539 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-3aeb4475-7e8a-48b8-836a-8a2e97ed027f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "swap": 0, "disk": 10}} {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:33.128196 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-3aeb4475-7e8a-48b8-836a-8a2e97ed027f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430134 Nov 02 07:22:33.134764 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 07:22:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:22:33.141662 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-2e127ca6-934d-4243-a7ae-472886dd4e0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:33.174260 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-2e127ca6-934d-4243-a7ae-472886dd4e0e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037042 Nov 02 07:22:33.178726 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Nov 2 07:22:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:35.845867 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-3aeb4475-7e8a-48b8-836a-8a2e97ed027f admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:22:35.847004 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-3aeb4475-7e8a-48b8-836a-8a2e97ed027f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Nov 02 07:22:35.847317 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 07:22:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:22:36.306052 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-e533a3d9-f04b-418b-b5da-834c0bcb85f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:36.326105 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-e533a3d9-f04b-418b-b5da-834c0bcb85f9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.472667 Nov 02 07:22:36.326905 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 07:22:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:22:36.341994 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-45c27b16-219f-4b65-a88b-2ff0d945a50e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:36.368716 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-45c27b16-219f-4b65-a88b-2ff0d945a50e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030096 Nov 02 07:22:36.369672 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1336 bytes} [Wed Nov 2 07:22:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:39.300637 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-e533a3d9-f04b-418b-b5da-834c0bcb85f9 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:22:39.301656 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-e533a3d9-f04b-418b-b5da-834c0bcb85f9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Nov 02 07:22:39.302061 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 07:22:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:22:39.737725 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-c9179893-c61d-4647-ac7e-abb1d4a9e6e9 admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:22:39.763722 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-c9179893-c61d-4647-ac7e-abb1d4a9e6e9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.453001 Nov 02 07:22:39.764282 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Nov 2 07:22:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:22:42.516684 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-e533a3d9-f04b-418b-b5da-834c0bcb85f9 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:22:42.517730 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-e533a3d9-f04b-418b-b5da-834c0bcb85f9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Nov 02 07:22:42.518142 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 07:22:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:22:42.929221 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-48dd91fd-4f3b-4c29-b012-3e6c31f7111d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "disk": 1, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0}} {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:42.950601 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-48dd91fd-4f3b-4c29-b012-3e6c31f7111d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.426371 Nov 02 07:22:42.951133 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 07:22:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 07:22:42.966224 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-5a626d8b-df34-4c88-a713-523c9d6450d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:43.002436 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-5a626d8b-df34-4c88-a713-523c9d6450d4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041474 Nov 02 07:22:43.003023 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Nov 2 07:22:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:45.648008 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-48dd91fd-4f3b-4c29-b012-3e6c31f7111d admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:22:45.650127 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-48dd91fd-4f3b-4c29-b012-3e6c31f7111d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001997 Nov 02 07:22:45.651031 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 07:22:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:22:46.041600 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-d0a0c8e3-d266-4fe6-92c5-1caef58b6118 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small", "vcpus": 1, "disk": 20, "rxtx_factor": 1.0}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:46.063385 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-d0a0c8e3-d266-4fe6-92c5-1caef58b6118 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.406065 Nov 02 07:22:46.064604 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 07:22:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 07:22:46.077118 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-bbe3d39d-c5da-4aec-bd19-7e9e996a7171 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:46.101427 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-bbe3d39d-c5da-4aec-bd19-7e9e996a7171 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028188 Nov 02 07:22:46.102100 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Nov 2 07:22:46 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:48.794114 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-d0a0c8e3-d266-4fe6-92c5-1caef58b6118 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:22:48.795071 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-d0a0c8e3-d266-4fe6-92c5-1caef58b6118 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Nov 02 07:22:48.795730 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 07:22:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:22:49.248727 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-56b8dd28-95d7-479b-9586-64a1cb26cd4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "rxtx_factor": 1.0, "id": "3", "disk": 40, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:49.278681 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-56b8dd28-95d7-479b-9586-64a1cb26cd4b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.476690 Nov 02 07:22:49.279509 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 07:22:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:22:49.292064 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-cc035943-d60a-4e5e-ae29-33f075bdccbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:49.318583 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-cc035943-d60a-4e5e-ae29-33f075bdccbe admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030786 Nov 02 07:22:49.319510 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Nov 2 07:22:49 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:51.951202 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-56b8dd28-95d7-479b-9586-64a1cb26cd4b admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:22:51.952213 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-56b8dd28-95d7-479b-9586-64a1cb26cd4b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Nov 02 07:22:51.952892 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 07:22:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:22:52.390499 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-fa6352ef-291b-4852-a06a-5866ac403dcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:52.396668 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:52.412783 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-fa6352ef-291b-4852-a06a-5866ac403dcc admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.453971 Nov 02 07:22:52.413543 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 07:22:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:22:52.425865 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-f14d03d3-73f2-4347-a1cb-91bf6e6f2c47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:52.450247 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-f14d03d3-73f2-4347-a1cb-91bf6e6f2c47 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027851 Nov 02 07:22:52.451100 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Nov 2 07:22:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:55.089624 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-fa6352ef-291b-4852-a06a-5866ac403dcc admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:22:55.090729 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-fa6352ef-291b-4852-a06a-5866ac403dcc admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Nov 02 07:22:55.094697 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 07:22:55 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:22:55.534601 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-59ffcd8e-dc74-403b-857b-96999916d4b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:55.546330 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG dbcounter [-] [103785] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:55.562499 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-59ffcd8e-dc74-403b-857b-96999916d4b2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.465396 Nov 02 07:22:55.566725 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1283 bytes} [Wed Nov 2 07:22:55 2022] POST /compute/v2.1/flavors => generated 408 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:22:55.575434 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-29e5788c-7f7d-41aa-ac38-a7e0e9705282 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:22:55.609356 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-29e5788c-7f7d-41aa-ac38-a7e0e9705282 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037975 Nov 02 07:22:55.609910 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1333 bytes} [Wed Nov 2 07:22:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:23:12.508463 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-59ffcd8e-dc74-403b-857b-96999916d4b2 admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:12.509466 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-59ffcd8e-dc74-403b-857b-96999916d4b2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Nov 02 07:23:12.510644 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 07:23:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:23:12.521148 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:12.899010 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-11bacdd7-4634-4ada-bc00-399dfc01a24b admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:12.917185 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-11bacdd7-4634-4ada-bc00-399dfc01a24b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400514 Nov 02 07:23:12.917719 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Nov 2 07:23:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:23:14.206968 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-59ffcd8e-dc74-403b-857b-96999916d4b2 admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:14.208002 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-59ffcd8e-dc74-403b-857b-96999916d4b2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 02 07:23:14.208415 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 07:23:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:23:14.748443 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-913f83c9-191b-4068-82eb-f639e84bc420 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:14.753687 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.wsgi [None req-913f83c9-191b-4068-82eb-f639e84bc420 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-913f83c9-191b-4068-82eb-f639e84bc420 admin admin] Request method failure captured: Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Accept: application/json Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Accept-Encoding: gzip, deflate Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Connection: keep-alive Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Content-Length: 0 Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Host: 10.222.0.18 Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Openstack-Api-Version: compute 2.92 Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Openstack-System-Scope: None Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: User-Agent: python-novaclient Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Auth-Token: gAAAAABjYhri4eKffWOE4DgtCt6brNS7CuNzUbAXjVcysLQzGvZTxsQgtUq6RJCT4vCwQMekmIacRkKjW6PKHgTTiODmgU41hkWDypjzd3eZQUBtX0XRFC3DbVJOzKvg0mBxpYFvddwsWrIgY3UqONg3iVSVZZSNu4p68RjqOmdeIOg4alYyUss Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Domain-Id: None Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Domain-Name: None Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Identity-Status: Confirmed Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Is-Admin-Project: True Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Project-Domain-Id: default Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Project-Domain-Name: Default Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Project-Id: 4ad924d40efc4e06bdd880c155ca36a4 Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Project-Name: admin Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Role: admin,member,reader Nov 02 07:23:14.756899 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Roles: admin,member,reader Nov 02 07:23:14.758593 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4ad924d40efc4e06bdd880c155ca36a4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:23:14.758593 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Tenant: admin Nov 02 07:23:14.758593 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Tenant-Id: 4ad924d40efc4e06bdd880c155ca36a4 Nov 02 07:23:14.758593 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Tenant-Name: admin Nov 02 07:23:14.758593 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-User: admin Nov 02 07:23:14.758593 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-User-Domain-Id: default Nov 02 07:23:14.758593 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-User-Domain-Name: Default Nov 02 07:23:14.758593 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-User-Id: b87b731cb4ea4070ae4dad0c3c393570 Nov 02 07:23:14.758593 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-User-Name: admin Nov 02 07:23:14.758593 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: method: > Nov 02 07:23:14.758593 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: exception: Flavor 42 could not be found. Nov 02 07:23:14.758593 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: action_args: {'id': '42'} Nov 02 07:23:14.758593 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:23:14.758593 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:23:14.759714 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Nov 02 07:23:14.761110 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-913f83c9-191b-4068-82eb-f639e84bc420 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103784) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:23:14.762428 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-913f83c9-191b-4068-82eb-f639e84bc420 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.395922 Nov 02 07:23:14.762428 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Nov 2 07:23:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 07:23:14.767922 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-50a6f28d-0bd3-4dd9-b0e8-8c536aee313d admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:14.792394 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-50a6f28d-0bd3-4dd9-b0e8-8c536aee313d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028095 Nov 02 07:23:14.792922 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Nov 2 07:23:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:23:14.803431 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-2fb7510f-e49f-4045-87e3-2620afb612ee admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:14.825316 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-2fb7510f-e49f-4045-87e3-2620afb612ee admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026266 Nov 02 07:23:14.825846 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Nov 2 07:23:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:23:14.835312 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-0a4c8260-6dd8-4228-a6bc-2cef09dc2e0d admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:14.842454 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.wsgi [None req-0a4c8260-6dd8-4228-a6bc-2cef09dc2e0d admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-0a4c8260-6dd8-4228-a6bc-2cef09dc2e0d admin admin] Request method failure captured: Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Accept: application/json Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Accept-Encoding: gzip, deflate Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Connection: keep-alive Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Content-Length: 0 Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Host: 10.222.0.18 Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Openstack-Api-Version: compute 2.92 Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Openstack-System-Scope: None Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: User-Agent: python-novaclient Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Auth-Token: gAAAAABjYhri4eKffWOE4DgtCt6brNS7CuNzUbAXjVcysLQzGvZTxsQgtUq6RJCT4vCwQMekmIacRkKjW6PKHgTTiODmgU41hkWDypjzd3eZQUBtX0XRFC3DbVJOzKvg0mBxpYFvddwsWrIgY3UqONg3iVSVZZSNu4p68RjqOmdeIOg4alYyUss Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Domain-Id: None Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Domain-Name: None Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Identity-Status: Confirmed Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Is-Admin-Project: True Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Project-Domain-Id: default Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Project-Domain-Name: Default Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Project-Id: 4ad924d40efc4e06bdd880c155ca36a4 Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Project-Name: admin Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Role: admin,member,reader Nov 02 07:23:14.845827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Roles: admin,member,reader Nov 02 07:23:14.847345 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4ad924d40efc4e06bdd880c155ca36a4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:23:14.847345 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Tenant: admin Nov 02 07:23:14.847345 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Tenant-Id: 4ad924d40efc4e06bdd880c155ca36a4 Nov 02 07:23:14.847345 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Tenant-Name: admin Nov 02 07:23:14.847345 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-User: admin Nov 02 07:23:14.847345 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-User-Domain-Id: default Nov 02 07:23:14.847345 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-User-Domain-Name: Default Nov 02 07:23:14.847345 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-User-Id: b87b731cb4ea4070ae4dad0c3c393570 Nov 02 07:23:14.847345 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-User-Name: admin Nov 02 07:23:14.847345 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: method: > Nov 02 07:23:14.847345 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: exception: Flavor 42 could not be found. Nov 02 07:23:14.847345 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: action_args: {'id': '42'} Nov 02 07:23:14.847345 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:23:14.847345 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:23:14.848228 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Nov 02 07:23:14.849261 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-0a4c8260-6dd8-4228-a6bc-2cef09dc2e0d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:23:14.850236 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-0a4c8260-6dd8-4228-a6bc-2cef09dc2e0d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015708 Nov 02 07:23:14.850236 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Nov 2 07:23:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 02 07:23:16.039282 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-2fb7510f-e49f-4045-87e3-2620afb612ee admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:16.040292 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-2fb7510f-e49f-4045-87e3-2620afb612ee admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Nov 02 07:23:16.040686 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 07:23:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:23:16.565132 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-1be1f4ae-a673-4933-9365-5556aa239c0d admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:16.570076 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.wsgi [None req-1be1f4ae-a673-4933-9365-5556aa239c0d admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-1be1f4ae-a673-4933-9365-5556aa239c0d admin admin] Request method failure captured: Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Accept: application/json Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Accept-Encoding: gzip, deflate Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Connection: keep-alive Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Content-Length: 0 Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Host: 10.222.0.18 Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Openstack-Api-Version: compute 2.92 Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Openstack-System-Scope: None Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: User-Agent: python-novaclient Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Auth-Token: gAAAAABjYhrjJ7XVxw0lSx0ne2noa4fAErLIU2BssuKHOG5G2S0G6WHxH9hNNjr5EibdoxD2wj1ypLcWBCoiEp8Vqfdv-tbU5m9h6T6aOMrGFRmZ1G5XEnURi04aWYwLu8Hl31yjdgWMjc2GGNntF7A4wAmzY3ZB7WsMMG5X5A5KzMhYxGPBwpI Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Domain-Id: None Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Domain-Name: None Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Identity-Status: Confirmed Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Is-Admin-Project: True Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Project-Domain-Id: default Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Project-Domain-Name: Default Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Project-Id: 4ad924d40efc4e06bdd880c155ca36a4 Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Project-Name: admin Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Role: admin,member,reader Nov 02 07:23:16.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Roles: admin,member,reader Nov 02 07:23:16.573168 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4ad924d40efc4e06bdd880c155ca36a4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:23:16.573168 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Tenant: admin Nov 02 07:23:16.573168 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Tenant-Id: 4ad924d40efc4e06bdd880c155ca36a4 Nov 02 07:23:16.573168 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Tenant-Name: admin Nov 02 07:23:16.573168 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-User: admin Nov 02 07:23:16.573168 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-User-Domain-Id: default Nov 02 07:23:16.573168 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-User-Domain-Name: Default Nov 02 07:23:16.573168 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-User-Id: b87b731cb4ea4070ae4dad0c3c393570 Nov 02 07:23:16.573168 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-User-Name: admin Nov 02 07:23:16.573168 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: method: > Nov 02 07:23:16.573168 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: exception: Flavor 84 could not be found. Nov 02 07:23:16.573168 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: action_args: {'id': '84'} Nov 02 07:23:16.573168 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:23:16.573168 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:23:16.574674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Nov 02 07:23:16.575860 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-1be1f4ae-a673-4933-9365-5556aa239c0d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:23:16.576827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-1be1f4ae-a673-4933-9365-5556aa239c0d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.395840 Nov 02 07:23:16.576827 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Nov 2 07:23:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 07:23:16.583238 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-7c438aa8-1091-454b-bafb-e7590cb4e835 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:16.598329 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-7c438aa8-1091-454b-bafb-e7590cb4e835 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018686 Nov 02 07:23:16.598951 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Nov 2 07:23:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:23:16.608009 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-14ce16b5-4fcf-4bb8-a20a-0977e71ee7fc admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:16.623388 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-14ce16b5-4fcf-4bb8-a20a-0977e71ee7fc admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018851 Nov 02 07:23:16.623893 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Nov 2 07:23:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:23:16.632763 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-b16916a8-cdc7-4d85-a492-f87ea3d62741 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:16.638478 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.wsgi [None req-b16916a8-cdc7-4d85-a492-f87ea3d62741 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-b16916a8-cdc7-4d85-a492-f87ea3d62741 admin admin] Request method failure captured: Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Accept: application/json Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Accept-Encoding: gzip, deflate Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Connection: keep-alive Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Content-Length: 0 Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Host: 10.222.0.18 Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Openstack-Api-Version: compute 2.92 Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Openstack-System-Scope: None Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: User-Agent: python-novaclient Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Auth-Token: gAAAAABjYhrjJ7XVxw0lSx0ne2noa4fAErLIU2BssuKHOG5G2S0G6WHxH9hNNjr5EibdoxD2wj1ypLcWBCoiEp8Vqfdv-tbU5m9h6T6aOMrGFRmZ1G5XEnURi04aWYwLu8Hl31yjdgWMjc2GGNntF7A4wAmzY3ZB7WsMMG5X5A5KzMhYxGPBwpI Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Domain-Id: None Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Domain-Name: None Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Identity-Status: Confirmed Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Is-Admin-Project: True Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Project-Domain-Id: default Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Project-Domain-Name: Default Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Project-Id: 4ad924d40efc4e06bdd880c155ca36a4 Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Project-Name: admin Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Role: admin,member,reader Nov 02 07:23:16.640006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Roles: admin,member,reader Nov 02 07:23:16.641335 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4ad924d40efc4e06bdd880c155ca36a4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:23:16.641335 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Tenant: admin Nov 02 07:23:16.641335 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Tenant-Id: 4ad924d40efc4e06bdd880c155ca36a4 Nov 02 07:23:16.641335 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Tenant-Name: admin Nov 02 07:23:16.641335 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-User: admin Nov 02 07:23:16.641335 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-User-Domain-Id: default Nov 02 07:23:16.641335 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-User-Domain-Name: Default Nov 02 07:23:16.641335 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-User-Id: b87b731cb4ea4070ae4dad0c3c393570 Nov 02 07:23:16.641335 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-User-Name: admin Nov 02 07:23:16.641335 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: method: > Nov 02 07:23:16.641335 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: exception: Flavor 84 could not be found. Nov 02 07:23:16.641335 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: action_args: {'id': '84'} Nov 02 07:23:16.641335 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:23:16.641335 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:23:16.642180 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Nov 02 07:23:16.643221 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-b16916a8-cdc7-4d85-a492-f87ea3d62741 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103784) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:23:16.644322 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-b16916a8-cdc7-4d85-a492-f87ea3d62741 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012676 Nov 02 07:23:16.644322 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Nov 2 07:23:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 07:23:17.845893 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-14ce16b5-4fcf-4bb8-a20a-0977e71ee7fc admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:17.846972 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-14ce16b5-4fcf-4bb8-a20a-0977e71ee7fc admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Nov 02 07:23:17.847359 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 07:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:23:18.368950 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-b844daa1-3e53-4da1-a5d7-a19ae7615846 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:18.374861 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.wsgi [None req-b844daa1-3e53-4da1-a5d7-a19ae7615846 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-b844daa1-3e53-4da1-a5d7-a19ae7615846 admin admin] Request method failure captured: Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Accept: application/json Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Accept-Encoding: gzip, deflate Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Connection: keep-alive Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Content-Length: 0 Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Host: 10.222.0.18 Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Openstack-Api-Version: compute 2.92 Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Openstack-System-Scope: None Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: User-Agent: python-novaclient Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Auth-Token: gAAAAABjYhrlAuksHzxNuSBZpsOuwIkheLDdS6ACiPuMtCZ4igZm6meVgyPj1iHwBRmikFH4JEHfAzldQMTSEh2ZnpaI1vm-U6eWg1r-D5P66ILHJY5F5ldNQbqwlfEnh43oeYKq3mf2R-bHv7Ze60OcZW04FUHy2kN6l_3QUmjsqPhClOaE09Y Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Domain-Id: None Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Domain-Name: None Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Identity-Status: Confirmed Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Is-Admin-Project: True Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Project-Domain-Id: default Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Project-Domain-Name: Default Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Project-Id: 4ad924d40efc4e06bdd880c155ca36a4 Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Project-Name: admin Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Role: admin,member,reader Nov 02 07:23:18.376354 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Roles: admin,member,reader Nov 02 07:23:18.378015 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4ad924d40efc4e06bdd880c155ca36a4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:23:18.378015 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Tenant: admin Nov 02 07:23:18.378015 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Tenant-Id: 4ad924d40efc4e06bdd880c155ca36a4 Nov 02 07:23:18.378015 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-Tenant-Name: admin Nov 02 07:23:18.378015 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-User: admin Nov 02 07:23:18.378015 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-User-Domain-Id: default Nov 02 07:23:18.378015 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-User-Domain-Name: Default Nov 02 07:23:18.378015 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-User-Id: b87b731cb4ea4070ae4dad0c3c393570 Nov 02 07:23:18.378015 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: X-User-Name: admin Nov 02 07:23:18.378015 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: method: > Nov 02 07:23:18.378015 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: exception: Flavor 451 could not be found. Nov 02 07:23:18.378015 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: action_args: {'id': '451'} Nov 02 07:23:18.378015 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:23:18.378015 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:23:18.379006 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Nov 02 07:23:18.380378 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-b844daa1-3e53-4da1-a5d7-a19ae7615846 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103784) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:23:18.381606 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-b844daa1-3e53-4da1-a5d7-a19ae7615846 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392641 Nov 02 07:23:18.381606 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Nov 2 07:23:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 07:23:18.388936 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-9efe83e9-7d50-4d97-bfb1-1c2725553ea5 admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:18.404571 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-9efe83e9-7d50-4d97-bfb1-1c2725553ea5 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019931 Nov 02 07:23:18.405075 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Nov 2 07:23:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:23:18.414294 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-c3396b7d-c213-4e79-8fa7-8c82ba0f7bb4 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:18.429592 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-c3396b7d-c213-4e79-8fa7-8c82ba0f7bb4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018780 Nov 02 07:23:18.430114 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Nov 2 07:23:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:23:18.439330 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-bf3ea959-cd7a-4cd4-9629-0b4c09042847 admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:18.444506 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.wsgi [None req-bf3ea959-cd7a-4cd4-9629-0b4c09042847 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-bf3ea959-cd7a-4cd4-9629-0b4c09042847 admin admin] Request method failure captured: Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Accept: application/json Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Accept-Encoding: gzip, deflate Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Connection: keep-alive Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Content-Length: 0 Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Host: 10.222.0.18 Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Openstack-Api-Version: compute 2.92 Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Openstack-System-Scope: None Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: User-Agent: python-novaclient Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Auth-Token: gAAAAABjYhrlAuksHzxNuSBZpsOuwIkheLDdS6ACiPuMtCZ4igZm6meVgyPj1iHwBRmikFH4JEHfAzldQMTSEh2ZnpaI1vm-U6eWg1r-D5P66ILHJY5F5ldNQbqwlfEnh43oeYKq3mf2R-bHv7Ze60OcZW04FUHy2kN6l_3QUmjsqPhClOaE09Y Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Domain-Id: None Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Domain-Name: None Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Identity-Status: Confirmed Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Is-Admin-Project: True Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Project-Domain-Id: default Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Project-Domain-Name: Default Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Project-Id: 4ad924d40efc4e06bdd880c155ca36a4 Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Project-Name: admin Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Role: admin,member,reader Nov 02 07:23:18.446010 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Roles: admin,member,reader Nov 02 07:23:18.447560 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4ad924d40efc4e06bdd880c155ca36a4", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4ad924d40efc4e06bdd880c155ca36a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:23:18.447560 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Tenant: admin Nov 02 07:23:18.447560 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Tenant-Id: 4ad924d40efc4e06bdd880c155ca36a4 Nov 02 07:23:18.447560 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-Tenant-Name: admin Nov 02 07:23:18.447560 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-User: admin Nov 02 07:23:18.447560 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-User-Domain-Id: default Nov 02 07:23:18.447560 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-User-Domain-Name: Default Nov 02 07:23:18.447560 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-User-Id: b87b731cb4ea4070ae4dad0c3c393570 Nov 02 07:23:18.447560 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: X-User-Name: admin Nov 02 07:23:18.447560 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: method: > Nov 02 07:23:18.447560 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: exception: Flavor 451 could not be found. Nov 02 07:23:18.447560 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: action_args: {'id': '451'} Nov 02 07:23:18.447560 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:23:18.447560 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:23:18.448479 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: ERROR nova.api.openstack.wsgi Nov 02 07:23:18.449871 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-bf3ea959-cd7a-4cd4-9629-0b4c09042847 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:23:18.451165 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-bf3ea959-cd7a-4cd4-9629-0b4c09042847 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011554 Nov 02 07:23:18.451382 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Nov 2 07:23:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 07:23:19.646229 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-c3396b7d-c213-4e79-8fa7-8c82ba0f7bb4 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:19.647139 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-c3396b7d-c213-4e79-8fa7-8c82ba0f7bb4 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Nov 02 07:23:19.647533 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 07:23:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:23:20.166994 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-626e6ae2-9a68-4e82-8891-2afb15d82b78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:23:20.186976 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-626e6ae2-9a68-4e82-8891-2afb15d82b78 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.402302 Nov 02 07:23:20.187510 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Nov 2 07:23:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:23:21.405148 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-c3396b7d-c213-4e79-8fa7-8c82ba0f7bb4 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:21.406147 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-c3396b7d-c213-4e79-8fa7-8c82ba0f7bb4 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Nov 02 07:23:21.406566 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 07:23:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:23:21.929222 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-928cabe2-7ac4-45ed-a0da-16e23348f7c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:23:21.947399 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-928cabe2-7ac4-45ed-a0da-16e23348f7c0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.402955 Nov 02 07:23:21.947929 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Nov 2 07:23:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:23:23.141965 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-c3396b7d-c213-4e79-8fa7-8c82ba0f7bb4 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:23.143096 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-c3396b7d-c213-4e79-8fa7-8c82ba0f7bb4 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Nov 02 07:23:23.143555 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 07:23:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:23:23.668132 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-fafc8d75-948c-446a-932c-bdfd2566b848 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:23:23.687428 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-fafc8d75-948c-446a-932c-bdfd2566b848 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.404367 Nov 02 07:23:23.687952 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Nov 2 07:23:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:23:24.891240 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-c3396b7d-c213-4e79-8fa7-8c82ba0f7bb4 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:24.892248 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-c3396b7d-c213-4e79-8fa7-8c82ba0f7bb4 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Nov 02 07:23:24.892635 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 07:23:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:23:25.412109 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-b1feaab9-fe02-43a3-9c84-3e462e7c4fa2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:23:25.430811 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-b1feaab9-fe02-43a3-9c84-3e462e7c4fa2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.400054 Nov 02 07:23:25.431275 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Nov 2 07:23:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:23:26.633073 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-c3396b7d-c213-4e79-8fa7-8c82ba0f7bb4 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:26.634088 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-c3396b7d-c213-4e79-8fa7-8c82ba0f7bb4 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Nov 02 07:23:26.634511 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 07:23:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:23:27.147982 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-3c6f3839-fabd-4536-8276-2187277f89a2 admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:23:27.169120 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-3c6f3839-fabd-4536-8276-2187277f89a2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.398787 Nov 02 07:23:27.169646 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Wed Nov 2 07:23:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:24:23.594784 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-c3396b7d-c213-4e79-8fa7-8c82ba0f7bb4 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:24:23.595794 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-c3396b7d-c213-4e79-8fa7-8c82ba0f7bb4 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Nov 02 07:24:23.596191 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 931 bytes} [Wed Nov 2 07:24:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:24:23.607251 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG dbcounter [-] [103785] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:23.992135 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-6298fab5-e4b6-4524-9adc-5e3097f9ba9d admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:24:24.012617 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-6298fab5-e4b6-4524-9adc-5e3097f9ba9d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410468 Nov 02 07:24:24.013139 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1292 bytes} [Wed Nov 2 07:24:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:24:24.036480 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_api:SELECT=14 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:24.040156 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-32bdbd5f-93f8-46bd-a66d-7142fc79f0d1 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:24:24.048119 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-32bdbd5f-93f8-46bd-a66d-7142fc79f0d1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013172 Nov 02 07:24:24.048637 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1283 bytes} [Wed Nov 2 07:24:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:24:24.060959 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-0cdffdec-bc25-4b13-92e0-667da18c17e4 admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:24:24.068098 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-0cdffdec-bc25-4b13-92e0-667da18c17e4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011508 Nov 02 07:24:24.068598 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1286 bytes} [Wed Nov 2 07:24:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:24:24.079844 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-d9b160be-75e5-466d-81a2-98491506b779 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:24:24.086857 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-d9b160be-75e5-466d-81a2-98491506b779 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010562 Nov 02 07:24:24.087369 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1286 bytes} [Wed Nov 2 07:24:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:24:24.098576 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-e16c6be9-dbab-4e52-a190-2b8cad53bb79 admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:24:24.106013 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-e16c6be9-dbab-4e52-a190-2b8cad53bb79 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010893 Nov 02 07:24:24.106542 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1283 bytes} [Wed Nov 2 07:24:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:27:20.095527 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-d9b160be-75e5-466d-81a2-98491506b779 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:27:20.096626 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-d9b160be-75e5-466d-81a2-98491506b779 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Nov 02 07:27:20.097027 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 07:27:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:27:20.245014 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG dbcounter [-] [103785] Writing DB stats nova_api:SELECT=6 {{(pid=103785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:20.401286 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-e09e1dc1-af87-4407-bcfa-a5938f38c86a admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:27:20.405945 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-e09e1dc1-af87-4407-bcfa-a5938f38c86a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:27:20.406449 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-e09e1dc1-af87-4407-bcfa-a5938f38c86a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:27:20.406879 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-e09e1dc1-af87-4407-bcfa-a5938f38c86a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:27:20.407584 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-e09e1dc1-af87-4407-bcfa-a5938f38c86a admin admin] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:27:20.408027 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-e09e1dc1-af87-4407-bcfa-a5938f38c86a admin admin] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:27:20.408442 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-e09e1dc1-af87-4407-bcfa-a5938f38c86a admin admin] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:27:20.439969 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-e09e1dc1-af87-4407-bcfa-a5938f38c86a admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.196405 Nov 02 07:27:20.440512 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Nov 2 07:27:20 2022] GET /compute/v2.1/os-services => generated 794 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 07:27:21.507555 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-d9b160be-75e5-466d-81a2-98491506b779 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:27:21.508553 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-d9b160be-75e5-466d-81a2-98491506b779 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Nov 02 07:27:21.509503 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 07:27:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:27:21.703796 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-0e1d969e-434b-4d33-9d9d-0d0bc933adf5 admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:27:21.707325 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-0e1d969e-434b-4d33-9d9d-0d0bc933adf5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:27:21.707906 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-0e1d969e-434b-4d33-9d9d-0d0bc933adf5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:27:21.708401 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-0e1d969e-434b-4d33-9d9d-0d0bc933adf5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:27:21.709179 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-0e1d969e-434b-4d33-9d9d-0d0bc933adf5 admin admin] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:27:21.709812 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-0e1d969e-434b-4d33-9d9d-0d0bc933adf5 admin admin] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:27:21.710235 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-0e1d969e-434b-4d33-9d9d-0d0bc933adf5 admin admin] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:27:21.730666 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-0e1d969e-434b-4d33-9d9d-0d0bc933adf5 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.082395 Nov 02 07:27:21.731224 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Nov 2 07:27:21 2022] GET /compute/v2.1/os-services => generated 794 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:27:33.202389 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-d9b160be-75e5-466d-81a2-98491506b779 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:27:33.203379 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-d9b160be-75e5-466d-81a2-98491506b779 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 02 07:27:33.203769 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 07:27:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:27:33.347121 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG dbcounter [-] [103785] Writing DB stats nova_cell0:SELECT=4 {{(pid=103785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:33.347836 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG dbcounter [-] [103785] Writing DB stats nova_cell1:SELECT=4 {{(pid=103785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:33.348512 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG dbcounter [-] [103785] Writing DB stats nova_api:SELECT=8 {{(pid=103785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:27:33.397512 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-bebff34b-944c-4fbb-a93c-e6779e954a9a admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:27:33.401184 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-bebff34b-944c-4fbb-a93c-e6779e954a9a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:27:33.401663 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-bebff34b-944c-4fbb-a93c-e6779e954a9a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:27:33.402192 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-bebff34b-944c-4fbb-a93c-e6779e954a9a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:27:33.402975 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-bebff34b-944c-4fbb-a93c-e6779e954a9a admin admin] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:27:33.403423 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-bebff34b-944c-4fbb-a93c-e6779e954a9a admin admin] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:27:33.403847 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-bebff34b-944c-4fbb-a93c-e6779e954a9a admin admin] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:27:33.429107 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-bebff34b-944c-4fbb-a93c-e6779e954a9a admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.086431 Nov 02 07:27:33.429594 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 38/74] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Nov 2 07:27:33 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:27:34.488316 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-d9b160be-75e5-466d-81a2-98491506b779 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:27:34.489320 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-d9b160be-75e5-466d-81a2-98491506b779 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Nov 02 07:27:34.489981 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Nov 2 07:27:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:27:34.679979 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG nova.api.openstack.wsgi [None req-13bb7ab5-2815-47d5-8290-3727b1db65e6 admin admin] Calling method '>' {{(pid=103785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:27:34.683674 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-13bb7ab5-2815-47d5-8290-3727b1db65e6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:27:34.684147 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-13bb7ab5-2815-47d5-8290-3727b1db65e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:27:34.684558 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-13bb7ab5-2815-47d5-8290-3727b1db65e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:27:34.685254 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-13bb7ab5-2815-47d5-8290-3727b1db65e6 admin admin] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:27:34.685687 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-13bb7ab5-2815-47d5-8290-3727b1db65e6 admin admin] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:27:34.686093 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: DEBUG oslo_concurrency.lockutils [None req-13bb7ab5-2815-47d5-8290-3727b1db65e6 admin admin] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:27:34.707613 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: INFO nova.api.openstack.requestlog [None req-13bb7ab5-2815-47d5-8290-3727b1db65e6 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.079843 Nov 02 07:27:34.708079 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: [pid: 103785|app: 0|req: 39/76] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Nov 2 07:27:34 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:28:30.189205 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: Wed Nov 2 07:28:30 2022 - graceful shutdown triggered... Nov 02 07:28:30.188920 dv-cinder-804735-33-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 02 07:28:30.190195 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: Gracefully killing worker 1 (pid: 103784)... Nov 02 07:28:30.190606 dv-cinder-804735-33-iscsi devstack@n-api.service[103785]: Gracefully killing worker 2 (pid: 103785)... Nov 02 07:28:30.317212 dv-cinder-804735-33-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_api:SELECT=4 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:28:31.189374 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: worker 1 buried after 1 seconds Nov 02 07:28:31.189374 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: worker 2 buried after 1 seconds Nov 02 07:28:31.189374 dv-cinder-804735-33-iscsi devstack@n-api.service[103783]: goodbye to uWSGI. Nov 02 07:28:31.190948 dv-cinder-804735-33-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 02 07:28:31.191503 dv-cinder-804735-33-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 02 07:28:31.194178 dv-cinder-804735-33-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 07:28:31.208385 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 07:28:31.210380 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 07:28:31 2022] *** Nov 02 07:28:31.210380 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 07:28:31.210585 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 07:28:31.210585 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: nodename: dv-cinder-804735-33-iscsi Nov 02 07:28:31.210585 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: machine: x86_64 Nov 02 07:28:31.210585 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: clock source: unix Nov 02 07:28:31.210585 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: pcre jit disabled Nov 02 07:28:31.210585 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: detected number of CPU cores: 4 Nov 02 07:28:31.210585 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: current working directory: / Nov 02 07:28:31.210585 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: detected binary path: /usr/bin/uwsgi-core Nov 02 07:28:31.210585 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: your processes number limit is 47680 Nov 02 07:28:31.210585 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: your memory page size is 4096 bytes Nov 02 07:28:31.210585 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: detected max file descriptor number: 2048 Nov 02 07:28:31.210585 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: lock engine: pthread robust mutexes Nov 02 07:28:31.210585 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: thunder lock: enabled Nov 02 07:28:31.211556 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 07:28:31.211556 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 07:28:31.251196 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: Python main interpreter initialized at 0x5580b03c39c0 Nov 02 07:28:31.251196 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: python threads support enabled Nov 02 07:28:31.251196 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: your server socket listen backlog is limited to 100 connections Nov 02 07:28:31.251196 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: your mercy for graceful operations on workers is 90 seconds Nov 02 07:28:31.251635 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 07:28:31.251635 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: *** Operational MODE: preforking *** Nov 02 07:28:31.251888 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: *** uWSGI is running in multiple interpreter mode *** Nov 02 07:28:31.251888 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: spawned uWSGI master process (pid: 118979) Nov 02 07:28:31.252097 dv-cinder-804735-33-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 02 07:28:31.254648 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: spawned uWSGI worker 1 (pid: 118991, cores: 1) Nov 02 07:28:31.254648 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: spawned uWSGI worker 2 (pid: 118992, cores: 1) Nov 02 07:28:31.254648 dv-cinder-804735-33-iscsi devstack@n-api.service[118979]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 07:28:31.917390 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 07:28:31.918650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 07:28:33.163613 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:28:33.163613 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: from cryptography.utils import int_from_bytes Nov 02 07:28:33.164235 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:28:33.164235 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: from cryptography.utils import int_from_bytes Nov 02 07:28:33.164631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:28:33.164631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: from cryptography.utils import int_from_bytes Nov 02 07:28:33.164803 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:28:33.164803 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: from cryptography.utils import int_from_bytes Nov 02 07:28:35.645235 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 07:28:35.645235 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 07:28:35.645706 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 07:28:35.645706 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 07:28:35.645887 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 07:28:35.646284 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.646652 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.646965 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.647292 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.647625 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.647939 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.648264 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.648585 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.648914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.649176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.649499 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.649827 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-33-iscsi {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.650152 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.650483 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.650797 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.651144 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.651419 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.651743 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.652048 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.652711 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.654049 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.654049 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.654049 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.654335 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.654453 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.654733 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.655051 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.655375 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.655681 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.655993 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.656400 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-33-iscsi {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.656718 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.657032 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.657346 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.657760 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.658073 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.658406 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.658732 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.659055 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.659364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.659731 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.660031 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.660351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.660671 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.660975 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.661287 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.661596 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.661916 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.662216 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.662546 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.662796 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.663106 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.663427 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.663747 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.664071 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.664322 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.664571 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.664889 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.665211 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.665521 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.665830 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.666138 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.666467 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.666776 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.667086 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.667395 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.667700 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.668557 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.668872 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.669194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.669501 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.669823 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.670226 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.670576 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.670886 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.671226 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.671545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.671854 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.672177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.672498 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.672807 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.673113 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.673420 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.673739 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.674073 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.674408 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.674651 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.674955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.675261 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.675581 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.675887 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.676194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.676500 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.676798 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.677105 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.677416 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.677714 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.678020 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.678326 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.678655 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.678956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.679261 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.679564 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.679868 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.680190 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.680510 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.680815 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.681120 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.681425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.681728 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.682049 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.682375 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.682692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.683084 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.683295 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.684240 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.684562 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.684872 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.685179 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.685499 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.685800 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.686110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.686450 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.686759 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.687064 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.687365 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.687668 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.687971 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.688274 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.688574 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.688876 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.689173 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.689489 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.689807 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.690122 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.690450 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.690757 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.691076 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.691413 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.691743 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.692086 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.692421 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.692733 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.693065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.693384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.693696 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.694013 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.694340 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.694675 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.694988 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.695299 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.695619 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.695938 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.696266 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.696582 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.696898 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.697216 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.697526 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.697845 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.698171 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.698517 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.698835 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.699242 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.699612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.699930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.700261 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.700584 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.700895 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.701206 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.701516 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.701856 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.702169 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.702553 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.702829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.703207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.703469 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.703786 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.704097 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.704410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.704725 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.705034 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.705368 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.706101 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.706266 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 07:28:35.706774 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.706906 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 07:28:35.707040 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.707040 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.707288 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 07:28:35.707434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.707568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 07:28:35.707703 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.707830 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 07:28:35.707956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.708081 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.708222 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.708349 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.708474 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.708599 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.708723 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.708873 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.709078 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.709217 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.709341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.709465 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.709588 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.709724 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.709855 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.709984 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.710114 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.710246 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.710412 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.710552 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.710689 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.710821 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.710944 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.711067 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-33-iscsi {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.711207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.711339 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.711463 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.711624 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.711760 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.711931 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.712069 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.712246 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.712375 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.712548 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.712686 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.712866 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.713003 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.713172 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.713309 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.713565 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.713668 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.713869 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.713965 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.714194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.714288 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.714527 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.714631 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.714945 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.715042 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.715266 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.715364 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.715579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.715680 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.715895 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.716024 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.716209 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.716313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.716519 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.716630 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.716830 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.716920 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.717143 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.717247 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-33-iscsi {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.717457 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.717557 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.717791 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.717897 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.718116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.718214 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.718439 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.718533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.718769 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.718860 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.719097 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.719197 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.719415 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.719513 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.719719 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.719810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.720035 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.720149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.720337 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.720447 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.720642 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.720763 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.720947 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.721050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.721255 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.721355 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.721559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.721696 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.721866 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.721977 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.722169 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.722277 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.722492 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.722594 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.722800 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.722918 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.723101 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.723192 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.723347 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.723477 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.723710 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.723815 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.724013 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.724104 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.724314 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.724406 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.724655 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.724755 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.724907 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.725005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.725141 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.725293 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.725457 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.725629 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.725774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.725956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.726136 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.726293 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.726548 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.726703 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.726854 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.726996 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.727136 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.727274 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.727421 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.727571 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.727729 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.727876 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.728046 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.728194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.728344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.728490 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.728629 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.728780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.728920 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.729065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.729297 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.729445 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.729592 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.729749 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.729889 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.730035 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.730189 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.730885 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.731041 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.731188 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.731469 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.731631 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.731781 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.731928 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.732068 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.732228 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.732369 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.732521 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.732667 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.732813 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.732952 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.733098 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.733237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.733384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.733647 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.733795 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.733942 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.734082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.734231 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.734404 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.734558 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.734742 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.734891 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.735038 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.735038 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.735330 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.735478 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.735624 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.735771 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.735910 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.736058 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.736208 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.736355 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.736503 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.736649 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.736788 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.736935 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.737075 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.737221 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.737360 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.737507 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.737645 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.737796 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.737942 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.738126 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.738273 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.738432 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.738579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.738730 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.738869 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.739014 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.739154 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.739319 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.739539 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.739699 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.739846 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.740004 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.740150 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.740543 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.740693 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.740840 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.740980 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.741118 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.741256 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.741401 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.741549 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.741697 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.741836 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.741987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.742144 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.742284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.742454 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.742604 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.742745 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.742896 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.743042 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.743181 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.743326 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.743472 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.743642 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.743788 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.743927 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.744076 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.744215 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.744360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.744512 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.744658 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.744807 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.744954 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.744954 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.745235 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.745383 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.745524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.745662 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.745811 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.746589 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.746766 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.746917 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.747060 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.747197 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.747336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.747474 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.747613 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.747760 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.747907 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.748046 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.748185 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.748323 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.748484 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.748622 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.748793 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.748941 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.749107 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.749253 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.749424 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.749658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.749804 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.749944 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.750090 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.750237 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.750435 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.750590 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.750740 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:28:35.750879 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.751018 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.751158 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.751308 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.751447 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.751586 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.751729 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.751875 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.752022 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.752169 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.752318 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.752458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.752596 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.752773 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.752933 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.753100 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.753248 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.753410 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.753562 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.753723 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.753880 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.754028 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.754165 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.754321 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.754525 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.754676 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.754816 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.754961 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.755100 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.755245 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.755520 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.755748 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.755897 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.756035 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.756172 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.756322 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.756461 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.756613 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.756762 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.756901 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.757047 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.757200 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.757340 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.757479 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.757655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.757801 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.757961 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.758108 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.758269 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.758431 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.758645 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.758799 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.758953 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.759092 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.759231 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.759376 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.759541 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.759774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.759935 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.760076 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.760222 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.760378 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.760518 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.760676 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.760817 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.760955 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.761100 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.761238 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.761376 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.761522 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.761690 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.761835 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.761983 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.762197 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.762341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.762551 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.762700 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.762848 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.762988 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.763126 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.763265 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.763416 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.763556 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.763695 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.763841 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.763988 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.764137 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.764285 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.764431 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.764578 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.764716 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.764855 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.765002 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.765144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.765289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.765443 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.765593 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.765740 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.765889 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.766046 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.766192 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.766333 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.766499 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.766650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.766798 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.766947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.767117 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.767264 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.767418 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.767557 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.767708 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.767848 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.767997 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.768146 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.768286 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.768437 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.768600 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.768752 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.768899 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.769038 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.769200 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.769359 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.769499 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.769637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.769802 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.770012 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.770164 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.770317 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.770510 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.770650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.770797 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.770937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.771083 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.771236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.771384 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.771528 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.771674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.771824 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.771971 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.772109 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.772248 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.772386 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.772523 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.772668 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.772816 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.772955 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.773100 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.773239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.773377 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.773516 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.773671 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.773818 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.773957 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.774094 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.774240 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.774400 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.774562 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.774703 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.774841 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.774979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.775124 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.775273 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.775431 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.775585 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.775731 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.775870 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.776015 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.776168 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.776315 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.776454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.776591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.776729 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.776898 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.777056 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.777228 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.777422 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.777595 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.777736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.777917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.778078 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.778225 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.778426 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.778584 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.778724 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.778871 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.779011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.779157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.779295 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.779467 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.779615 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.779780 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.779991 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.780205 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.780356 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.780497 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.780636 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.780783 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.780924 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.781063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.781201 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.781347 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.781505 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.781655 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.781796 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.781942 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.782082 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.782220 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.782394 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.782542 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.782683 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.782831 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.782968 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.783107 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.783257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.783407 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.783545 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.783692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.783841 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.783981 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.784132 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.784272 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.784418 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.784623 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.784777 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.784926 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.785073 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.785220 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.785374 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.785540 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.785687 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.785835 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.785983 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.786154 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.786308 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.786502 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.786643 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.786862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.787020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.787174 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.787328 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.787485 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.787639 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.787794 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.787949 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.788095 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.788248 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.788395 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.788553 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.788708 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.788855 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.789001 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.789145 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.789300 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.789465 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.789620 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.789773 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.789927 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.790072 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.790242 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.790499 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.790661 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.790809 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.790955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.791111 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.791264 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.791429 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.791586 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.791739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.791892 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.792039 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.792192 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.792350 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.792497 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.792649 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.793313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.793470 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.793631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.793779 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.793942 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.794089 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.794234 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.794395 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.794623 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.794780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.794934 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.795081 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.795235 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.795388 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.795547 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.795694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.795839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.796006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.796159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.796314 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.796468 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.796621 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.796767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.796918 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.797072 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.797233 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.797382 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.797535 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.797690 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.797854 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.798007 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.798162 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.798316 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.798488 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.798636 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.798781 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.798935 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.799093 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.799240 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.799393 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.799546 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.799691 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.799847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.800005 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.800159 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.800305 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.800469 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.800694 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.800859 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.801043 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.801200 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.801354 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.801354 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.801642 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.801796 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.801956 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.801956 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.802239 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.802425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.802585 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.802744 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.802890 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.803036 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.803188 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.803188 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.803465 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.803465 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.803756 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.803912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.804057 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.804057 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.804353 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.804507 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.804654 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.804799 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.804945 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.805096 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.805250 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.805403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.805555 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.805712 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.805867 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.806021 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.806177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.806330 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.806508 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.806743 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.806972 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.807133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.807280 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.807431 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.807578 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.807730 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.807887 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.808041 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.808187 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.808331 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.809128 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.809234 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.809328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.809423 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.809508 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.809591 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.809711 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.809870 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.810021 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.810202 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.810345 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.810544 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.810678 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.810865 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.810991 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.811175 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.811303 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.811510 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.811639 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.811836 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.811943 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.812152 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.812251 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.812484 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.812763 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.812936 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.813094 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.813242 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.813409 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.813563 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.813716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.813910 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.814060 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.814207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.814393 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.814561 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.814715 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.814870 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.815016 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.815173 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.815333 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.815481 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.815627 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.815780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.815935 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.816081 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.816236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.816401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.816547 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.816694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.816839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.816992 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.817147 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.817295 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.817447 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.817595 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.817740 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.817885 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.818044 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.818198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.818429 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.818590 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.818741 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.818903 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.819051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.819197 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.819344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.819496 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.819650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.819806 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.819961 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.820108 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.820263 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.820428 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.820583 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.820739 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.820979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.821142 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.821297 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.821444 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.821590 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.821745 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.821892 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.822045 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.822192 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.822348 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.822537 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.822687 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.822832 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.822984 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.823138 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.823284 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.823439 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.823587 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.823740 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.823893 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.824182 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.824357 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.824530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.824530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.824810 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.824956 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.825108 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.825292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.825452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.825610 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.825759 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.825912 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.826072 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.826231 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.826406 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.826584 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.826739 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.826892 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.827039 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.827194 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.827341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.827485 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.827631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.827777 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.827928 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.828083 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.828238 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.828394 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.828540 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.828697 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.828853 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.829008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.829162 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.829308 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.829461 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.829607 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.829762 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.829909 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.830054 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.830198 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.830376 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.830531 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.830702 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.830852 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.831082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.831237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.831237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.831513 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.831672 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.831826 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.831974 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.832120 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.832271 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.832435 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.832747 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.832913 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.833070 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.833218 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.833373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.833534 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.833688 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.833836 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.833983 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.834136 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.834283 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.834463 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.834627 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.834782 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.834929 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.835076 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.835231 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.835387 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.835534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.835687 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.835848 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.836014 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.836170 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.836324 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.836574 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.836574 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.836908 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.837065 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.837215 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.837362 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.837516 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.837670 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.837818 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.837977 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.838124 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.838272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.838441 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.838609 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.838771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.838934 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.839082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.839230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.839384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.839531 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.839830 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.839993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.840142 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.840291 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.840446 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.840605 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.840777 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.840934 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.841108 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.841339 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.841502 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.841665 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.841820 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.841969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.842116 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.842270 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.842452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.842625 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.842784 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.842932 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.842932 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.843227 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.843385 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.843546 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.843695 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.843841 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.843995 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.844142 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.844301 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.844456 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.844614 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.844760 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.844914 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.845070 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.845225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.845384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.845540 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.845687 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.845840 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.845988 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.846145 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.846293 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.846464 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.846640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.846797 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.846985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.847106 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.847200 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.847287 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.847372 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.847456 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.847564 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.847688 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.847795 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.847889 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.847981 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.848066 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.848162 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.848254 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.848339 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.848433 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.848433 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.848605 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.848696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.848781 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.848781 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.848940 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.849059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.849233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.849392 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.849557 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.849715 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.849870 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.850030 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.850192 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.850340 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.850528 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.850684 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.850841 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.850988 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.851149 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.851327 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.851547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.851700 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.851848 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.852003 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.852159 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.852305 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.852473 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.852659 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.852817 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.852974 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.853131 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.853292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.853448 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.853601 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.853749 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.853917 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.854066 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.854212 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.854406 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.854574 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.854730 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.854886 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.855042 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.855189 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.855852 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.856007 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.856162 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.856319 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.856473 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.856669 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.856824 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.856993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.857156 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.857316 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.857464 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.857667 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.857850 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.858014 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.858172 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.858320 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.858505 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.858656 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.858802 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.858957 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.859116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.859273 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.859428 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.859575 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.859721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.859868 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.860042 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.860203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.860350 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.860496 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.860651 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.860798 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.860957 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.861106 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.861261 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.861408 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.861571 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.861804 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.861969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.862116 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.862271 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.862476 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.862629 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.862787 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.862948 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.863103 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.863103 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.863399 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.863553 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.863709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.863856 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.864021 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.864168 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.864322 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.864471 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.864627 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.864782 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.864938 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.865095 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.865506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.865665 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.865812 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.865812 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.866090 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.866090 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.866405 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.866571 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.866727 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.866875 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.867029 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.867177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.867331 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.867532 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.867683 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.867829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.867984 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.868133 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.868289 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.868289 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.868656 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.868804 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.868959 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.869106 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.869262 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.869410 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.869557 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.869712 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.869859 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.870023 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.870200 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.870348 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.870529 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.870691 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.870847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.871063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.871228 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.871376 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.871524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.871524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.871828 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.872056 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.872210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.872375 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.872531 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.872687 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.872843 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.872999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.873148 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.873302 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.873450 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.873604 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.873759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.873916 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.874064 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.874229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.874408 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.874574 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.874722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.874879 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.875034 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.875188 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.875336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.875490 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.875650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.875798 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.875944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.876091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.876250 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.876396 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.876552 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.876700 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.876846 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.876994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.877147 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.877303 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.877462 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.877611 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.877757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.877911 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.878068 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.878232 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.878406 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.878572 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.878728 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.878876 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.879023 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.879180 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.879327 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.879474 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.879627 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.879776 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.879931 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.880102 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.880256 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.880404 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.880557 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.880712 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.880867 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.881028 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.881184 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.881331 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.881486 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.881633 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.881793 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.881793 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.882167 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.882332 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.882518 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.882667 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.882831 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.882981 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.883135 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.883284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.883431 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.883577 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.883737 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.883885 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.884043 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.884190 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.884338 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.884497 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.884652 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.884807 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.884961 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.885109 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.885255 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.885411 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.885558 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.885712 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.885860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.886017 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.886164 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.886323 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.886505 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.887166 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.887323 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.887589 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.887752 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.887913 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.888070 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.888219 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.888366 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.888514 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.888679 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.888828 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.888993 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.889141 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.889288 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.889435 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.889591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.889739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.889893 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.890040 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.890187 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.890334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.890570 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.890727 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.890882 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.891042 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.891189 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.891335 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.891491 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.891647 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.891795 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.891941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.892087 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.892327 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.892493 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.892652 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.892808 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.892808 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.893105 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.893266 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.893414 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.893569 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.893717 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.893864 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.894009 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.894165 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.894312 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.894492 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.894693 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.894859 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.895008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.895168 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.895316 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.895464 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.895609 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.895763 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.895921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.896076 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.896237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.896385 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.896550 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.896699 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.896854 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.897004 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.897158 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.897307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.897453 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.897602 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.897828 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.897980 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.898135 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.898291 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.898492 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.898666 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.898815 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.898963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.899110 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.899268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.899416 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.899572 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.899727 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.899882 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.900031 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.900177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.900347 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.900543 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.900695 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.900848 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.900996 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.901151 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.901312 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.901475 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.901631 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.901786 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.901934 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.902088 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.902467 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.902672 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.902832 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.902988 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.903135 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.903298 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.903447 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.903594 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.903750 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.903898 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.904052 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.904210 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.904359 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.904517 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.904671 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.904818 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.904965 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.905126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.905275 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.905429 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.905429 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.905715 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.905863 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.906018 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.906176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.906325 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.906521 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.906678 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.906844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.906992 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.907139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.907294 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.907443 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.907589 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.907589 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.907887 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.908035 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.908181 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.908338 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.908486 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.908645 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.908793 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.908940 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.909087 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.909240 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.909402 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118991) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 07:28:35.909561 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.909561 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.909561 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.909561 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.910109 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.910397 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.910822 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.911140 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.911542 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.911872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.912240 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.912658 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.912993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.913301 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.913607 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.913922 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.914231 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.914561 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.914867 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.915298 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.915614 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.915917 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.916223 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.916601 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.916964 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.917278 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.917659 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.918520 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.918804 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.919190 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.919799 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.920207 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.920563 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.921074 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.921421 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.921786 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.922145 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.922564 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.922974 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.923292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.923599 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.923948 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.924282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.924723 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.925126 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.925603 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.925936 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.926253 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.926595 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.926944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.927261 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.927806 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.928142 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.928462 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.929261 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.929261 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.929578 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.929736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.929983 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.930306 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.930649 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.930959 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.931270 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.931579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.931886 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.932198 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.932505 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.932814 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.933121 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.933458 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.933795 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.934109 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.934433 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.934744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.935056 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.935414 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.935709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.936027 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.936339 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.936656 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.936965 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.937274 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.937580 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.937889 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.938279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.938648 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.938962 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.939267 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.939687 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.940000 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.940315 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.940635 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.940945 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.941265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.941585 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.941897 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.942220 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.942553 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.942883 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.943219 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.943545 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.943867 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.944170 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.944471 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.944772 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.945080 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.945396 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.945704 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.946006 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.946306 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.946636 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.946936 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.947236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.947537 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.948033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.948341 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.948642 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.948944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.950001 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.950319 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.950652 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.950959 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.951271 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.951574 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.951878 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.952181 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.952491 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.952792 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.953124 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.953458 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.953773 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.954097 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.954427 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.954752 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.955061 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.955381 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.955705 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.956020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.956328 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.956661 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.956968 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.957278 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.957589 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.957900 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.958206 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.958604 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.958934 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.959261 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.959567 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.959892 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.960211 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.960532 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.960847 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.961159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.961487 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.961797 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.962113 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.962444 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.962756 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.963066 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.963383 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.963693 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.964002 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.964318 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.964631 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.965084 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.965414 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.965725 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.966051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.966395 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.966748 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.967059 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.967401 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.967728 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.968041 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.968353 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.968656 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:28:35.968898 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 07:28:35.972618 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO dbcounter [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] Registered counter for database nova_api Nov 02 07:28:35.993633 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_db.sqlalchemy.engines [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:28:36.002313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writer thread running {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:28:36.037748 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO dbcounter [None req-153e2c55-45f3-4381-9654-097e92703105 None None] Registered counter for database nova_api Nov 02 07:28:36.060574 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_db.sqlalchemy.engines [None req-153e2c55-45f3-4381-9654-097e92703105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:28:36.061607 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.context [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a592cbfe-d5e4-461b-8a54-ba6eff3d281b(cell1) {{(pid=118991) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 07:28:36.065671 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:28:36.066144 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:28:36.067763 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:28:36.067895 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writer thread running {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:28:36.068493 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:28:36.068939 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:28:36.070978 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:28:36.073014 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO dbcounter [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] Registered counter for database nova_cell0 Nov 02 07:28:36.077349 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO dbcounter [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] Registered counter for database nova_cell1 Nov 02 07:28:36.086552 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_db.sqlalchemy.engines [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:28:36.090605 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_db.sqlalchemy.engines [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:28:36.094325 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writer thread running {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:28:36.127011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.context [None req-153e2c55-45f3-4381-9654-097e92703105 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a592cbfe-d5e4-461b-8a54-ba6eff3d281b(cell1) {{(pid=118992) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 07:28:36.131051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-153e2c55-45f3-4381-9654-097e92703105 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:28:36.131524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-153e2c55-45f3-4381-9654-097e92703105 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:28:36.133103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-153e2c55-45f3-4381-9654-097e92703105 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:28:36.133826 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-153e2c55-45f3-4381-9654-097e92703105 None None] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:28:36.134263 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-153e2c55-45f3-4381-9654-097e92703105 None None] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:28:36.136288 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-153e2c55-45f3-4381-9654-097e92703105 None None] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:28:36.138477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO dbcounter [None req-153e2c55-45f3-4381-9654-097e92703105 None None] Registered counter for database nova_cell0 Nov 02 07:28:36.143168 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO dbcounter [None req-153e2c55-45f3-4381-9654-097e92703105 None None] Registered counter for database nova_cell1 Nov 02 07:28:36.150650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_db.sqlalchemy.engines [None req-153e2c55-45f3-4381-9654-097e92703105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:28:36.154633 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_db.sqlalchemy.engines [None req-153e2c55-45f3-4381-9654-097e92703105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:28:36.162512 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writer thread running {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:28:36.162875 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writer thread running {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:28:36.242632 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writer thread running {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:28:36.251651 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO dbcounter [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] Registered counter for database nova_cell0 Nov 02 07:28:36.260905 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_db.sqlalchemy.engines [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:28:36.265936 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writer thread running {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:28:36.312709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO dbcounter [None req-153e2c55-45f3-4381-9654-097e92703105 None None] Registered counter for database nova_cell0 Nov 02 07:28:36.320684 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_db.sqlalchemy.engines [None req-153e2c55-45f3-4381-9654-097e92703105 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:28:36.327141 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writer thread running {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:28:36.588535 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: WARNING keystonemiddleware.auth_token [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 07:28:36.597696 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: WARNING keystonemiddleware.auth_token [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 07:28:36.650405 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: WARNING keystonemiddleware.auth_token [None req-153e2c55-45f3-4381-9654-097e92703105 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 07:28:36.658331 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: WARNING keystonemiddleware.auth_token [None req-153e2c55-45f3-4381-9654-097e92703105 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 07:28:36.946488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: WARNING keystonemiddleware.auth_token [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 07:28:36.952592 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: WARNING keystonemiddleware.auth_token [None req-2081a5b6-8c65-4fa6-959e-437ade7aaa0e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 07:28:36.957880 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5580b03c39c0 pid: 118991 (default app) Nov 02 07:28:37.002606 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: WARNING keystonemiddleware.auth_token [None req-153e2c55-45f3-4381-9654-097e92703105 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 07:28:37.008537 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: WARNING keystonemiddleware.auth_token [None req-153e2c55-45f3-4381-9654-097e92703105 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 07:28:37.014000 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580b03c39c0 pid: 118992 (default app) Nov 02 07:29:12.174973 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=3 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:12.176168 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=3 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:12.177273 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=3 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:12.179250 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=3 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:13.568712 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-21725b42-d2e7-41a3-aa99-507ce1f222d0 tempest-VolumesGetTestJSON-350093428 tempest-VolumesGetTestJSON-350093428-project] Action: 'create', calling method: .version_select at 0x7f4d6b2e9f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1861983750", "metadata": {"Type": "work"}}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:29:13.848813 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=3 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:13.850523 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=3 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:13.851278 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=3 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:13.853348 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=3 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:15.628755 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9e922218-4eb3-45e6-aee6-4a5e72cb7409 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Action: 'create', calling method: .version_select at 0x7f4d6b2e8ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1174537287"}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:29:16.266459 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-21725b42-d2e7-41a3-aa99-507ce1f222d0 tempest-VolumesGetTestJSON-350093428 tempest-VolumesGetTestJSON-350093428-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.102056 Nov 02 07:29:16.267423 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Nov 2 07:29:12 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4105 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 07:29:16.273155 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c82df9be-06aa-4856-928f-8c7c86c8590f tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] Calling method '.version_select at 0x7f4d6b170dc0>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:16.909704 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c82df9be-06aa-4856-928f-8c7c86c8590f tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/fed6f6a7-747a-4611-af23-6d6bf88e7e29" status: 200 len: 351 microversion: 2.1 time: 0.640838 Nov 02 07:29:16.926795 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 2/2] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 07:29:16 2022] GET /compute/v2.1/os-volumes/fed6f6a7-747a-4611-af23-6d6bf88e7e29 => generated 351 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:16.938202 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-02e11d7a-a70d-45c2-97be-00b3a6ce5f87 tempest-VolumesGetTestJSON-350093428 tempest-VolumesGetTestJSON-350093428-project] Calling method '.version_select at 0x7f4d6b104550>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:17.374462 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-02e11d7a-a70d-45c2-97be-00b3a6ce5f87 tempest-VolumesGetTestJSON-350093428 tempest-VolumesGetTestJSON-350093428-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/0470dd06-3231-4778-aae9-291159d67cf5" status: 200 len: 354 microversion: 2.1 time: 0.446419 Nov 02 07:29:17.375140 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 3/3] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 07:29:16 2022] GET /compute/v2.1/os-volumes/0470dd06-3231-4778-aae9-291159d67cf5 => generated 354 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:17.390033 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-08062d60-b640-4a85-b9f0-0e2853eda9fe tempest-VolumesGetTestJSON-350093428 tempest-VolumesGetTestJSON-350093428-project] Calling method '.version_select at 0x7f4d6b104c10>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:17.438199 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9e922218-4eb3-45e6-aee6-4a5e72cb7409 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.595887 Nov 02 07:29:17.439784 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 1/4] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Nov 2 07:29:13 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3599 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 02 07:29:17.462056 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-bda74d0c-b7b7-4d54-9585-cdbc735accfa tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Calling method '.version_select at 0x7f4d6b16dd30>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:17.651564 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-08062d60-b640-4a85-b9f0-0e2853eda9fe tempest-VolumesGetTestJSON-350093428 tempest-VolumesGetTestJSON-350093428-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/0470dd06-3231-4778-aae9-291159d67cf5" status: 200 len: 354 microversion: 2.1 time: 0.266976 Nov 02 07:29:17.660158 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 4/5] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 07:29:17 2022] GET /compute/v2.1/os-volumes/0470dd06-3231-4778-aae9-291159d67cf5 => generated 354 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:17.666468 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-bda74d0c-b7b7-4d54-9585-cdbc735accfa tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/478f9c6a-023d-4e18-9bfe-2c546f77ce30" status: 200 len: 346 microversion: 2.1 time: 0.210232 Nov 02 07:29:17.675202 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 2/6] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 07:29:17 2022] GET /compute/v2.1/os-volumes/478f9c6a-023d-4e18-9bfe-2c546f77ce30 => generated 346 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:17.675619 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2657a072-3951-42fb-a8c6-83a225cea294 tempest-VolumesGetTestJSON-350093428 tempest-VolumesGetTestJSON-350093428-project] Calling method '.version_select at 0x7f4d6b104b80>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:17.683515 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9ad58169-a965-410d-b5b3-137e27e6ede6 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Action: 'create', calling method: .version_select at 0x7f4d6b1033a0>, body: {"snapshot": {"volume_id": "478f9c6a-023d-4e18-9bfe-2c546f77ce30", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1945836383"}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:29:17.934063 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2657a072-3951-42fb-a8c6-83a225cea294 tempest-VolumesGetTestJSON-350093428 tempest-VolumesGetTestJSON-350093428-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/0470dd06-3231-4778-aae9-291159d67cf5" status: 202 len: 0 microversion: 2.1 time: 0.262791 Nov 02 07:29:17.934671 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 5/7] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 07:29:17 2022] DELETE /compute/v2.1/os-volumes/0470dd06-3231-4778-aae9-291159d67cf5 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:29:17.943411 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d5b596b6-89a2-4510-82df-3194f43740c4 tempest-VolumesGetTestJSON-350093428 tempest-VolumesGetTestJSON-350093428-project] Calling method '.version_select at 0x7f4d6b1044c0>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:18.148460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d5b596b6-89a2-4510-82df-3194f43740c4 tempest-VolumesGetTestJSON-350093428 tempest-VolumesGetTestJSON-350093428-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/0470dd06-3231-4778-aae9-291159d67cf5" status: 200 len: 353 microversion: 2.1 time: 0.209767 Nov 02 07:29:18.149266 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 6/8] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 07:29:17 2022] GET /compute/v2.1/os-volumes/0470dd06-3231-4778-aae9-291159d67cf5 => generated 353 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:29:18.291046 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9ad58169-a965-410d-b5b3-137e27e6ede6 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.612170 Nov 02 07:29:18.291922 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 3/9] 10.222.0.18 () {60 vars in 1162 bytes} [Wed Nov 2 07:29:17 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:18.304635 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-40aaa57e-eb15-409a-a823-9d60a4e5ea68 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Calling method '.version_select at 0x7f4d6b170e50>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:18.427988 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-40aaa57e-eb15-409a-a823-9d60a4e5ea68 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022" status: 200 len: 287 microversion: 2.1 time: 0.128003 Nov 02 07:29:18.429272 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 7/10] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 07:29:18 2022] GET /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022 => generated 287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:18.441951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-5d311e4d-dd30-40b3-a0ac-a6cad786e472 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Calling method '.version_select at 0x7f4d6b10a670>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:18.535112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-5d311e4d-dd30-40b3-a0ac-a6cad786e472 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.096538 Nov 02 07:29:18.542303 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 4/11] 10.222.0.18 () {58 vars in 1140 bytes} [Wed Nov 2 07:29:18 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:18.548492 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8f34ceb5-e550-4fe4-9042-0fa025af233d tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Calling method '.version_select at 0x7f4d6b170f70>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:18.635678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8f34ceb5-e550-4fe4-9042-0fa025af233d tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022" status: 200 len: 287 microversion: 2.1 time: 0.091529 Nov 02 07:29:18.637919 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 8/12] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 07:29:18 2022] GET /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022 => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:19.155158 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-4c878fba-f128-4fc5-9903-edcddf932ade tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] Calling method '.version_select at 0x7f4d6b1031f0>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:19.164997 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-83eec127-2483-48c2-bcd4-da8e547dad78 tempest-VolumesGetTestJSON-350093428 tempest-VolumesGetTestJSON-350093428-project] Calling method '.version_select at 0x7f4d6b104550>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:19.227355 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-83eec127-2483-48c2-bcd4-da8e547dad78 tempest-VolumesGetTestJSON-350093428 tempest-VolumesGetTestJSON-350093428-project] HTTP exception thrown: Volume 0470dd06-3231-4778-aae9-291159d67cf5 could not be found. Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-83eec127-2483-48c2-bcd4-da8e547dad78 tempest-VolumesGetTestJSON-350093428 tempest-VolumesGetTestJSON-350093428-project] Request method failure captured: Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/os-volumes/0470dd06-3231-4778-aae9-291159d67cf5 HTTP/1.1 Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhxIyN213eEF7n6xW_qaEYTXvxTyGtR8Fg8Rh_RRG454qsdsimyPYiFAMGWjlFQn_9DZktMimtKFSs0rr9WKDMhDx6LNSXjBteQxrUW7s_r6pCCN5XW_r65PcVcF6y3y_A7qs4IH--h187JS2_-WGYWz-NFjVkCtcgyDbC-c_aGygNU Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: 948d495ca7dc4cc4a2b8cb2e2d621324 Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-VolumesGetTestJSON-350093428 Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:29:19.232398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:29:19.233960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_948d495ca7dc4cc4a2b8cb2e2d621324", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/948d495ca7dc4cc4a2b8cb2e2d621324"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/948d495ca7dc4cc4a2b8cb2e2d621324"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/948d495ca7dc4cc4a2b8cb2e2d621324"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:29:19.233960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-VolumesGetTestJSON-350093428 Nov 02 07:29:19.233960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: 948d495ca7dc4cc4a2b8cb2e2d621324 Nov 02 07:29:19.233960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-VolumesGetTestJSON-350093428 Nov 02 07:29:19.233960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-VolumesGetTestJSON-350093428-project Nov 02 07:29:19.233960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:29:19.233960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:29:19.233960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 72e9291d458043139a23efef6ff415ea Nov 02 07:29:19.233960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-VolumesGetTestJSON-350093428-project Nov 02 07:29:19.233960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: Nov 02 07:29:19.233960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Volume 0470dd06-3231-4778-aae9-291159d67cf5 could not be found. Nov 02 07:29:19.233960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': '0470dd06-3231-4778-aae9-291159d67cf5'} Nov 02 07:29:19.233960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0470dd06-3231-4778-aae9-291159d67cf5 could not be found. (HTTP 404) (Request-ID: req-acb268f0-c2c0-4377-95a0-8f3b4f711fba) Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:29:19.234930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 07:29:19.236426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0470dd06-3231-4778-aae9-291159d67cf5 could not be found. Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 07:29:19.237771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:29:19.239091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0470dd06-3231-4778-aae9-291159d67cf5 could not be found. Nov 02 07:29:19.239091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:19.239091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:29:19.239091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:19.239091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:19.239091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:29:19.239091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:29:19.239091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:29:19.239091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:29:19.239091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0470dd06-3231-4778-aae9-291159d67cf5 could not be found. Nov 02 07:29:19.239091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:19.239091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-83eec127-2483-48c2-bcd4-da8e547dad78 tempest-VolumesGetTestJSON-350093428 tempest-VolumesGetTestJSON-350093428-project] Returning 404 to user: Volume 0470dd06-3231-4778-aae9-291159d67cf5 could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:29:19.239091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-83eec127-2483-48c2-bcd4-da8e547dad78 tempest-VolumesGetTestJSON-350093428 tempest-VolumesGetTestJSON-350093428-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/0470dd06-3231-4778-aae9-291159d67cf5" status: 404 len: 109 microversion: 2.1 time: 0.073744 Nov 02 07:29:19.239091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 9/13] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 07:29:19 2022] GET /compute/v2.1/os-volumes/0470dd06-3231-4778-aae9-291159d67cf5 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:29:19.301689 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-4c878fba-f128-4fc5-9903-edcddf932ade tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8c549b8a-378b-4cbc-a4ae-254d48caf163" status: 200 len: 350 microversion: 2.1 time: 0.152163 Nov 02 07:29:19.302258 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 5/14] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 07:29:19 2022] GET /compute/v2.1/os-volumes/8c549b8a-378b-4cbc-a4ae-254d48caf163 => generated 350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:19.652269 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b8e11951-3a28-4a25-b5cd-48f295c0753f tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Calling method '.version_select at 0x7f4d6b110790>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:19.720017 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b8e11951-3a28-4a25-b5cd-48f295c0753f tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022" status: 200 len: 287 microversion: 2.1 time: 0.072785 Nov 02 07:29:19.721089 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 10/15] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 07:29:19 2022] GET /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:20.734207 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-894a2ce8-656e-40b5-bae0-a427ab199ba3 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Calling method '.version_select at 0x7f4d6b16dc10>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:20.899585 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-894a2ce8-656e-40b5-bae0-a427ab199ba3 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022" status: 200 len: 287 microversion: 2.1 time: 0.170173 Nov 02 07:29:20.900541 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 6/16] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 07:29:20 2022] GET /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022 => generated 287 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:21.912774 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a562cfa2-4bdc-44c4-b3f8-412903be0e8e tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Calling method '.version_select at 0x7f4d6b110e50>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:21.961428 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a562cfa2-4bdc-44c4-b3f8-412903be0e8e tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022" status: 200 len: 288 microversion: 2.1 time: 0.052398 Nov 02 07:29:21.962392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 11/17] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 07:29:21 2022] GET /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022 => generated 288 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:21.974112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-338a739a-11e3-411f-8e8e-066a48d6bec5 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Calling method '.version_select at 0x7f4d6b10a0d0>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:22.138236 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0cd0653a-f785-4648-aec3-6795f0c853d0 tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] Calling method '.version_select at 0x7f4d6b078550>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:22.154685 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-338a739a-11e3-411f-8e8e-066a48d6bec5 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022" status: 202 len: 0 microversion: 2.1 time: 0.184379 Nov 02 07:29:22.155582 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 7/18] 10.222.0.18 () {58 vars in 1254 bytes} [Wed Nov 2 07:29:21 2022] DELETE /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:29:22.166757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-773c3bc4-65ba-49d8-b491-ee1c637b0a15 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Calling method '.version_select at 0x7f4d6b10a550>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:22.240248 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-773c3bc4-65ba-49d8-b491-ee1c637b0a15 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022" status: 200 len: 287 microversion: 2.1 time: 0.079551 Nov 02 07:29:22.241079 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 8/19] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 07:29:22 2022] GET /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:22.318343 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0cd0653a-f785-4648-aec3-6795f0c853d0 tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/fe1ff0fc-cffe-425a-8059-af953d24c477" status: 200 len: 350 microversion: 2.1 time: 0.183765 Nov 02 07:29:22.320152 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 12/20] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 07:29:22 2022] GET /compute/v2.1/os-volumes/fe1ff0fc-cffe-425a-8059-af953d24c477 => generated 350 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:22.335083 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-4969bdb6-251d-43ce-8bb3-ae0e42dd9813 tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] Calling method '.version_select at 0x7f4d6b2acee0>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:22.504879 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-4969bdb6-251d-43ce-8bb3-ae0e42dd9813 tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.174352 Nov 02 07:29:22.505937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 9/21] 10.222.0.18 () {58 vars in 1134 bytes} [Wed Nov 2 07:29:22 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:22.522914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-9772fbe1-e1b8-4f69-bdb7-2851e12aefd3 tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] Calling method '.version_select at 0x7f4d6b110d30>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:22.704613 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-9772fbe1-e1b8-4f69-bdb7-2851e12aefd3 tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.186203 Nov 02 07:29:22.705427 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 13/22] 10.222.0.18 () {58 vars in 1149 bytes} [Wed Nov 2 07:29:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:22.719801 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0f9a07b8-482b-4291-99ee-a0cf69a49a35 tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] Calling method '.version_select at 0x7f4d6b1164c0>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:22.944069 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-0f9a07b8-482b-4291-99ee-a0cf69a49a35 tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.227895 Nov 02 07:29:22.954289 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 10/23] 10.222.0.18 () {58 vars in 1134 bytes} [Wed Nov 2 07:29:22 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:22.959488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ed9b3171-77a8-482e-97d8-692bd80a4b92 tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] Calling method '.version_select at 0x7f4d6b0780d0>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:23.116760 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ed9b3171-77a8-482e-97d8-692bd80a4b92 tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.161699 Nov 02 07:29:23.117781 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 14/24] 10.222.0.18 () {58 vars in 1167 bytes} [Wed Nov 2 07:29:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:23.132111 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ce6448fd-b9d4-49a7-8b2f-ea801244db8b tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] Calling method '.version_select at 0x7f4d6baf0310>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:23.258211 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-74cf5dda-bcb3-4ef4-8371-64347c2cd879 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Calling method '.version_select at 0x7f4d6b082ca0>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:23.289879 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-74cf5dda-bcb3-4ef4-8371-64347c2cd879 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] HTTP exception thrown: Snapshot fe6e18e6-b817-4e89-b9da-d079d1d55022 could not be found. Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-74cf5dda-bcb3-4ef4-8371-64347c2cd879 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Request method failure captured: Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022 HTTP/1.1 Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhxJ8iH67jkNwctGr_Pl8jQhFMIDl6HGjIhFfAfqm7F6JVUXnfkCA2ZMQDyXJblEQ0igDTTrx4pAvrS85zjMJXw4ZaKToY5FVUz1qnmfL10yx7XS88DojvERtJcjkb4F_rKUHeimCv7bYnnBBpuYkowRBEwJn8QshCcWOERWsR1WDgk Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: f6181ebe47b443b9b5e57bffd9e08244 Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-938416130 Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:29:23.293692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:29:23.295458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6181ebe47b443b9b5e57bffd9e08244", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6181ebe47b443b9b5e57bffd9e08244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6181ebe47b443b9b5e57bffd9e08244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6181ebe47b443b9b5e57bffd9e08244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:29:23.295458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-VolumesSnapshotsTestJSON-938416130 Nov 02 07:29:23.295458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: f6181ebe47b443b9b5e57bffd9e08244 Nov 02 07:29:23.295458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-938416130 Nov 02 07:29:23.295458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-VolumesSnapshotsTestJSON-938416130-project Nov 02 07:29:23.295458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:29:23.295458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:29:23.295458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 8a0b861fb7d042c89c1be0101dbbc735 Nov 02 07:29:23.295458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-VolumesSnapshotsTestJSON-938416130-project Nov 02 07:29:23.295458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: Nov 02 07:29:23.295458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Snapshot fe6e18e6-b817-4e89-b9da-d079d1d55022 could not be found. Nov 02 07:29:23.295458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': 'fe6e18e6-b817-4e89-b9da-d079d1d55022'} Nov 02 07:29:23.295458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fe6e18e6-b817-4e89-b9da-d079d1d55022 could not be found. (HTTP 404) (Request-ID: req-856a1ee3-1abd-4632-aedf-ef3a0673116a) Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:23.296384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 07:29:23.297640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fe6e18e6-b817-4e89-b9da-d079d1d55022 could not be found. Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Nov 02 07:29:23.298963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:29:23.300328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fe6e18e6-b817-4e89-b9da-d079d1d55022 could not be found. Nov 02 07:29:23.300328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:23.300328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:29:23.300328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:23.300328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:23.300328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:29:23.300328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:29:23.300328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:29:23.300328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:29:23.300328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fe6e18e6-b817-4e89-b9da-d079d1d55022 could not be found. Nov 02 07:29:23.300328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:23.301865 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-74cf5dda-bcb3-4ef4-8371-64347c2cd879 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Returning 404 to user: Snapshot fe6e18e6-b817-4e89-b9da-d079d1d55022 could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:29:23.303006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-74cf5dda-bcb3-4ef4-8371-64347c2cd879 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022" status: 404 len: 111 microversion: 2.1 time: 0.050486 Nov 02 07:29:23.304043 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 15/25] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 07:29:23 2022] GET /compute/v2.1/os-snapshots/fe6e18e6-b817-4e89-b9da-d079d1d55022 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 07:29:23.317093 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-593c1ce4-1935-4bec-8b01-366deedc2a55 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Calling method '.version_select at 0x7f4d6b082280>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:23.342420 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ce6448fd-b9d4-49a7-8b2f-ea801244db8b tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.213900 Nov 02 07:29:23.344637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 11/26] 10.222.0.18 () {58 vars in 1170 bytes} [Wed Nov 2 07:29:23 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:23.362635 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-60c1bfb9-d6e4-4136-ba26-b0334755dd7d tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] Calling method '.version_select at 0x7f4d6b1161f0>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:23.523939 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-593c1ce4-1935-4bec-8b01-366deedc2a55 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/478f9c6a-023d-4e18-9bfe-2c546f77ce30" status: 202 len: 0 microversion: 2.1 time: 0.214095 Nov 02 07:29:23.524770 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 16/27] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 07:29:23 2022] DELETE /compute/v2.1/os-volumes/478f9c6a-023d-4e18-9bfe-2c546f77ce30 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 07:29:23.534470 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d65cc5d9-851b-40a0-829e-9d74cd29969b tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Calling method '.version_select at 0x7f4d6b078d30>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:23.629226 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-60c1bfb9-d6e4-4136-ba26-b0334755dd7d tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.274862 Nov 02 07:29:23.631382 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 12/28] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 07:29:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:23.644862 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-fe394a21-a9c7-46be-b659-9fa87049e02d tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] Calling method '.version_select at 0x7f4d6b11f160>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:23.653661 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d65cc5d9-851b-40a0-829e-9d74cd29969b tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/478f9c6a-023d-4e18-9bfe-2c546f77ce30" status: 200 len: 345 microversion: 2.1 time: 0.123806 Nov 02 07:29:23.654662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 17/29] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 07:29:23 2022] GET /compute/v2.1/os-volumes/478f9c6a-023d-4e18-9bfe-2c546f77ce30 => generated 345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:29:23.943461 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-fe394a21-a9c7-46be-b659-9fa87049e02d tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.302277 Nov 02 07:29:23.944916 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 13/30] 10.222.0.18 () {58 vars in 1188 bytes} [Wed Nov 2 07:29:23 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:23.961332 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-4259c665-f21a-4b62-a647-8ec72ca8693a tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] Calling method '.version_select at 0x7f4d6b082160>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:24.250036 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-4259c665-f21a-4b62-a647-8ec72ca8693a tempest-VolumesTestJSON-849460473 tempest-VolumesTestJSON-849460473-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.294565 Nov 02 07:29:24.266128 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 18/31] 10.222.0.18 () {58 vars in 1155 bytes} [Wed Nov 2 07:29:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:24.673097 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0939a092-e1e3-4bf4-ae98-7e5223ffcf2e tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Calling method '.version_select at 0x7f4d6b1161f0>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:24.736388 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-0939a092-e1e3-4bf4-ae98-7e5223ffcf2e tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] HTTP exception thrown: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0939a092-e1e3-4bf4-ae98-7e5223ffcf2e tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Request method failure captured: Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/os-volumes/478f9c6a-023d-4e18-9bfe-2c546f77ce30 HTTP/1.1 Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhxJ8iH67jkNwctGr_Pl8jQhFMIDl6HGjIhFfAfqm7F6JVUXnfkCA2ZMQDyXJblEQ0igDTTrx4pAvrS85zjMJXw4ZaKToY5FVUz1qnmfL10yx7XS88DojvERtJcjkb4F_rKUHeimCv7bYnnBBpuYkowRBEwJn8QshCcWOERWsR1WDgk Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: f6181ebe47b443b9b5e57bffd9e08244 Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-938416130 Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:29:24.744502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:29:24.746272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6181ebe47b443b9b5e57bffd9e08244", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6181ebe47b443b9b5e57bffd9e08244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6181ebe47b443b9b5e57bffd9e08244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6181ebe47b443b9b5e57bffd9e08244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:29:24.746272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-VolumesSnapshotsTestJSON-938416130 Nov 02 07:29:24.746272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: f6181ebe47b443b9b5e57bffd9e08244 Nov 02 07:29:24.746272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-938416130 Nov 02 07:29:24.746272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-VolumesSnapshotsTestJSON-938416130-project Nov 02 07:29:24.746272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:29:24.746272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:29:24.746272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 8a0b861fb7d042c89c1be0101dbbc735 Nov 02 07:29:24.746272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-VolumesSnapshotsTestJSON-938416130-project Nov 02 07:29:24.746272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: Nov 02 07:29:24.746272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. Nov 02 07:29:24.746272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '478f9c6a-023d-4e18-9bfe-2c546f77ce30'} Nov 02 07:29:24.746272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. (HTTP 404) (Request-ID: req-41f15693-2ae4-474a-aeaf-ebaefb39f118) Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:29:24.747157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 07:29:24.748334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 07:29:24.749509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:29:24.753511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. Nov 02 07:29:24.753511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.753511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:29:24.753511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.753511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:24.753511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:29:24.753511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:29:24.753511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:29:24.753511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:29:24.753511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. Nov 02 07:29:24.753511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.757401 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0939a092-e1e3-4bf4-ae98-7e5223ffcf2e tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Returning 404 to user: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:29:24.759707 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-0939a092-e1e3-4bf4-ae98-7e5223ffcf2e tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/478f9c6a-023d-4e18-9bfe-2c546f77ce30" status: 404 len: 109 microversion: 2.1 time: 0.090373 Nov 02 07:29:24.773538 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 14/32] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 07:29:24 2022] GET /compute/v2.1/os-volumes/478f9c6a-023d-4e18-9bfe-2c546f77ce30 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:29:24.782724 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0fb8abc2-9d82-4f57-823a-bf77a235e076 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Calling method '.version_select at 0x7f4d6b078ca0>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:24.823063 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-0fb8abc2-9d82-4f57-823a-bf77a235e076 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] HTTP exception thrown: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0fb8abc2-9d82-4f57-823a-bf77a235e076 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Request method failure captured: Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: DELETE /compute/v2.1/os-volumes/478f9c6a-023d-4e18-9bfe-2c546f77ce30 HTTP/1.1 Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhxJ8iH67jkNwctGr_Pl8jQhFMIDl6HGjIhFfAfqm7F6JVUXnfkCA2ZMQDyXJblEQ0igDTTrx4pAvrS85zjMJXw4ZaKToY5FVUz1qnmfL10yx7XS88DojvERtJcjkb4F_rKUHeimCv7bYnnBBpuYkowRBEwJn8QshCcWOERWsR1WDgk Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: f6181ebe47b443b9b5e57bffd9e08244 Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-938416130 Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:29:24.826658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:29:24.828197 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6181ebe47b443b9b5e57bffd9e08244", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6181ebe47b443b9b5e57bffd9e08244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6181ebe47b443b9b5e57bffd9e08244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6181ebe47b443b9b5e57bffd9e08244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:29:24.828197 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-VolumesSnapshotsTestJSON-938416130 Nov 02 07:29:24.828197 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: f6181ebe47b443b9b5e57bffd9e08244 Nov 02 07:29:24.828197 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-938416130 Nov 02 07:29:24.828197 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-VolumesSnapshotsTestJSON-938416130-project Nov 02 07:29:24.828197 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:29:24.828197 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:29:24.828197 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 8a0b861fb7d042c89c1be0101dbbc735 Nov 02 07:29:24.828197 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-VolumesSnapshotsTestJSON-938416130-project Nov 02 07:29:24.828197 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: Nov 02 07:29:24.828197 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. Nov 02 07:29:24.828197 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': '478f9c6a-023d-4e18-9bfe-2c546f77ce30'} Nov 02 07:29:24.828197 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. (HTTP 404) (Request-ID: req-0f922b31-39f7-48df-bec2-3bc5b017f957) Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:29:24.829161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 07:29:24.830524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 07:29:24.833364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:29:24.834460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. Nov 02 07:29:24.834460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.834460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:29:24.834460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.834460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:24.834460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:29:24.834460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:29:24.834460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:29:24.834460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:29:24.834460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. Nov 02 07:29:24.834460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.834460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0fb8abc2-9d82-4f57-823a-bf77a235e076 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Returning 404 to user: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:29:24.834460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0fb8abc2-9d82-4f57-823a-bf77a235e076 tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/478f9c6a-023d-4e18-9bfe-2c546f77ce30" status: 404 len: 109 microversion: 2.1 time: 0.053822 Nov 02 07:29:24.836875 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 19/33] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 07:29:24 2022] DELETE /compute/v2.1/os-volumes/478f9c6a-023d-4e18-9bfe-2c546f77ce30 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:29:24.844858 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-aff76052-01ec-4752-9cb1-30461cabe64f tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Calling method '.version_select at 0x7f4d6b116310>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:24.909733 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-aff76052-01ec-4752-9cb1-30461cabe64f tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] HTTP exception thrown: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-aff76052-01ec-4752-9cb1-30461cabe64f tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Request method failure captured: Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/os-volumes/478f9c6a-023d-4e18-9bfe-2c546f77ce30 HTTP/1.1 Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhxJ8iH67jkNwctGr_Pl8jQhFMIDl6HGjIhFfAfqm7F6JVUXnfkCA2ZMQDyXJblEQ0igDTTrx4pAvrS85zjMJXw4ZaKToY5FVUz1qnmfL10yx7XS88DojvERtJcjkb4F_rKUHeimCv7bYnnBBpuYkowRBEwJn8QshCcWOERWsR1WDgk Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: f6181ebe47b443b9b5e57bffd9e08244 Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-938416130 Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:29:24.914888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:29:24.916236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f6181ebe47b443b9b5e57bffd9e08244", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6181ebe47b443b9b5e57bffd9e08244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f6181ebe47b443b9b5e57bffd9e08244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f6181ebe47b443b9b5e57bffd9e08244"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:29:24.916236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-VolumesSnapshotsTestJSON-938416130 Nov 02 07:29:24.916236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: f6181ebe47b443b9b5e57bffd9e08244 Nov 02 07:29:24.916236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-938416130 Nov 02 07:29:24.916236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-VolumesSnapshotsTestJSON-938416130-project Nov 02 07:29:24.916236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:29:24.916236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:29:24.916236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 8a0b861fb7d042c89c1be0101dbbc735 Nov 02 07:29:24.916236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-VolumesSnapshotsTestJSON-938416130-project Nov 02 07:29:24.916236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: Nov 02 07:29:24.916236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. Nov 02 07:29:24.916236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '478f9c6a-023d-4e18-9bfe-2c546f77ce30'} Nov 02 07:29:24.916236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. (HTTP 404) (Request-ID: req-c2d5726c-6964-405d-bfef-0631d2248ccc) Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:29:24.916987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 07:29:24.918837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 07:29:24.922077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:29:24.925012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. Nov 02 07:29:24.925012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.925012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:29:24.925012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.925012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:29:24.925012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:29:24.925012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:29:24.925012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:29:24.925012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:29:24.925012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. Nov 02 07:29:24.925012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:29:24.925012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-aff76052-01ec-4752-9cb1-30461cabe64f tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] Returning 404 to user: Volume 478f9c6a-023d-4e18-9bfe-2c546f77ce30 could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:29:24.925012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-aff76052-01ec-4752-9cb1-30461cabe64f tempest-VolumesSnapshotsTestJSON-938416130 tempest-VolumesSnapshotsTestJSON-938416130-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/478f9c6a-023d-4e18-9bfe-2c546f77ce30" status: 404 len: 109 microversion: 2.1 time: 0.079247 Nov 02 07:29:24.925012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 15/34] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 07:29:24 2022] GET /compute/v2.1/os-volumes/478f9c6a-023d-4e18-9bfe-2c546f77ce30 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:29:25.661843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1330076493", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:29:25.932266 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.network.neutron [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] validate_networks() for [('f40ed210-eb7b-4935-8be8-8b7615c77c12', None, None, None, None, None)] {{(pid=118991) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:29:27.447136 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-084d2448-bf6b-4faa-a369-04a551f1ca1a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Action: 'create', calling method: .version_select at 0x7f4d6b119940>, body: {"keypair": {"name": "tempest-keypair-1107069774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUsbq2FyWk+qXdM2pBa1H72JzA6LZkloPPs53Zvzy5hd1hhOK/oya0J+Lfl2PsBhBarivvI16utUICyOoDbLmxvKF+Byqj/smBrITf8Lwv5qMLkdpdsjZ4LI6T9LJwJtw=="}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:29:27.537314 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-084d2448-bf6b-4faa-a369-04a551f1ca1a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Getting quotas for project df168e1504c947169b74f50c1ed4de95. Resources: {'key_pairs'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:29:27.545818 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-084d2448-bf6b-4faa-a369-04a551f1ca1a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Getting quotas for user 2455ebfc92ba4d398a6279d6102a0408 and project df168e1504c947169b74f50c1ed4de95. Resources: {'key_pairs'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:29:27.648448 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-084d2448-bf6b-4faa-a369-04a551f1ca1a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.844638 Nov 02 07:29:27.649389 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 16/35] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Nov 2 07:29:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 846 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Nov 02 07:29:28.413415 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Flavor limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:29:28.413415 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Image limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:29:28.413415 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Flavor pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:29:28.413415 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Image pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:29:28.413415 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:29:28.478777 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:28.479655 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:28.482284 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:28.483305 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:28.486918 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:28.488862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:28.564713 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Getting quotas for project c60cb95cbf734d9b852af2bdcad4e1c0. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:29:28.583984 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Getting quotas for user 0e571b0f4d6f4fafb71939f501b8deec and project c60cb95cbf734d9b852af2bdcad4e1c0. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:29:28.609577 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Going to run 1 instances... {{(pid=118991) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:29:28.614389 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:29:28.833626 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-4c348b04-cb34-4bde-ae60-787c1c623c7b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.924968 Nov 02 07:29:28.847588 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-98593373-f12d-4c8a-ac74-d96329163906 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:28.848725 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-98593373-f12d-4c8a-ac74-d96329163906 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:28.853853 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 20/36] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:29:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 3946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 07:29:29.128822 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-98593373-f12d-4c8a-ac74-d96329163906 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:29.158114 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-98593373-f12d-4c8a-ac74-d96329163906 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1222 microversion: 2.1 time: 0.314993 Nov 02 07:29:29.167070 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 17/37] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:28 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1222 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:30.248764 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1950914015", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:29:30.447554 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.network.neutron [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] validate_networks() for [('f40ed210-eb7b-4935-8be8-8b7615c77c12', None, None, None, None, None)] {{(pid=118992) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:29:30.786745 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-509530595", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452", "networks": [{"uuid": "11191c9e-d03e-442c-a794-03d78c42edeb"}]}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:29:30.931774 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.network.neutron [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] validate_networks() for [('11191c9e-d03e-442c-a794-03d78c42edeb', None, None, None, None, None)] {{(pid=118991) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:29:32.992796 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Flavor limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:29:32.994252 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Image limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:29:32.995303 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Flavor pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:29:32.996287 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Image pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:29:32.997103 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:29:33.017173 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:33.019781 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:33.020497 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:33.021662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:33.025004 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:33.026290 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:33.099215 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Getting quotas for project f676ec82a80f4425a6fa7562ee47a4cf. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:29:33.110155 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Getting quotas for user 17a6f8d01e6d433ca467238f07ec15ba and project f676ec82a80f4425a6fa7562ee47a4cf. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:29:33.140509 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Going to run 1 instances... {{(pid=118991) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:29:33.146149 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:29:33.263772 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a83937da-7301-4804-8c72-6b68fd6ccbf0 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.106699 Nov 02 07:29:33.266289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 21/38] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:29:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 07:29:33.280950 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-762aa5a3-14fd-4dd5-a5f5-096f83e52dc7 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:33.281635 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-762aa5a3-14fd-4dd5-a5f5-096f83e52dc7 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:33.778806 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-762aa5a3-14fd-4dd5-a5f5-096f83e52dc7 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:33.833414 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-762aa5a3-14fd-4dd5-a5f5-096f83e52dc7 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1214 microversion: 2.1 time: 0.551606 Nov 02 07:29:33.834331 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 22/39] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:33 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1214 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:29:34.557489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Flavor limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:29:34.559323 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Image limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:29:34.560030 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Flavor pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:29:34.560619 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Image pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:29:34.561210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:29:34.612197 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:34.614115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:34.615828 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:34.618127 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:34.619222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:34.628722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:34.746638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Getting quotas for project c60cb95cbf734d9b852af2bdcad4e1c0. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:29:34.751915 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Getting quotas for user 0e571b0f4d6f4fafb71939f501b8deec and project c60cb95cbf734d9b852af2bdcad4e1c0. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:29:34.794739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Going to run 1 instances... {{(pid=118992) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:29:34.806101 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:29:34.862678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-65cee87e-7f81-43c0-95e1-b25e4b7cf5c2 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:34.864116 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-65cee87e-7f81-43c0-95e1-b25e4b7cf5c2 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:35.002704 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-65cee87e-7f81-43c0-95e1-b25e4b7cf5c2 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:35.011487 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-65cee87e-7f81-43c0-95e1-b25e4b7cf5c2 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1214 microversion: 2.1 time: 0.153716 Nov 02 07:29:35.018834 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 23/40] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:34 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:29:35.022730 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-6bfb0b93-1563-46b5-858f-5c3ca3b31319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.779340 Nov 02 07:29:35.026326 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 18/41] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:29:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 4783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 07:29:35.041281 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-45152060-8c2a-4f14-b9cc-f96dd89be980 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:35.041906 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-45152060-8c2a-4f14-b9cc-f96dd89be980 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:35.193173 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-243140215", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc944948-bf48-4be4-9702-2103a8c937e6"}], "security_groups": [{"name": "tempest-securitygroup--1478573750"}], "key_name": "tempest-keypair-1107069774", "user_data": "}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:29:35.298834 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-45152060-8c2a-4f14-b9cc-f96dd89be980 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:35.312684 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-45152060-8c2a-4f14-b9cc-f96dd89be980 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1222 microversion: 2.1 time: 0.277201 Nov 02 07:29:35.326861 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 24/42] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:35 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1222 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:35.650335 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.network.neutron [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] validate_networks() for [('dc944948-bf48-4be4-9702-2103a8c937e6', None, None, None, None, None)] {{(pid=118992) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:29:36.050352 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-32bfefe6-0d33-4aeb-ac33-2bbbd6fe7ce3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:36.051073 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-32bfefe6-0d33-4aeb-ac33-2bbbd6fe7ce3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:36.070132 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-32bfefe6-0d33-4aeb-ac33-2bbbd6fe7ce3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:36.070674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-32bfefe6-0d33-4aeb-ac33-2bbbd6fe7ce3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:36.071119 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-32bfefe6-0d33-4aeb-ac33-2bbbd6fe7ce3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:36.084810 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-32bfefe6-0d33-4aeb-ac33-2bbbd6fe7ce3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:36.085309 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-32bfefe6-0d33-4aeb-ac33-2bbbd6fe7ce3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:36.085752 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-32bfefe6-0d33-4aeb-ac33-2bbbd6fe7ce3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:36.724032 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-32bfefe6-0d33-4aeb-ac33-2bbbd6fe7ce3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:36.771566 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-32bfefe6-0d33-4aeb-ac33-2bbbd6fe7ce3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1266 microversion: 2.1 time: 0.722400 Nov 02 07:29:36.773236 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 25/43] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:36 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1266 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:36.812730 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-29a238ed-b3af-4a41-a14c-fa1cf961d6a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:36.817238 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-29a238ed-b3af-4a41-a14c-fa1cf961d6a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:36.844504 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-29a238ed-b3af-4a41-a14c-fa1cf961d6a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:36.860781 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-29a238ed-b3af-4a41-a14c-fa1cf961d6a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:36.863107 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-29a238ed-b3af-4a41-a14c-fa1cf961d6a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:36.868246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-29a238ed-b3af-4a41-a14c-fa1cf961d6a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:36.872699 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-29a238ed-b3af-4a41-a14c-fa1cf961d6a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:36.875270 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-29a238ed-b3af-4a41-a14c-fa1cf961d6a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:37.389484 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-29a238ed-b3af-4a41-a14c-fa1cf961d6a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:37.397792 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-29a238ed-b3af-4a41-a14c-fa1cf961d6a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1226 microversion: 2.1 time: 0.619496 Nov 02 07:29:37.400807 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 26/44] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:36 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1226 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:37.801620 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-551a506e-78bc-4e6b-9fba-05b8160833e6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:37.802933 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-551a506e-78bc-4e6b-9fba-05b8160833e6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:37.813538 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Flavor limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:29:37.814652 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Image limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:29:37.815474 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Flavor pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:29:37.816030 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Image pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:29:37.816587 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:29:37.820949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-551a506e-78bc-4e6b-9fba-05b8160833e6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:37.825425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-551a506e-78bc-4e6b-9fba-05b8160833e6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:37.836010 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-551a506e-78bc-4e6b-9fba-05b8160833e6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:37.836010 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-551a506e-78bc-4e6b-9fba-05b8160833e6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:37.836010 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-551a506e-78bc-4e6b-9fba-05b8160833e6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:37.836010 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-551a506e-78bc-4e6b-9fba-05b8160833e6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:37.849065 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:37.849787 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:37.850405 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:37.851285 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:37.851878 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:37.852838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:37.888587 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Getting quotas for project df168e1504c947169b74f50c1ed4de95. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:29:37.903584 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Getting quotas for user 2455ebfc92ba4d398a6279d6102a0408 and project df168e1504c947169b74f50c1ed4de95. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:29:37.952150 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Going to run 1 instances... {{(pid=118992) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:29:37.955124 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:29:38.076554 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3abcec30-aeda-48bf-9bce-6498e540f469 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.899338 Nov 02 07:29:38.077614 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 19/45] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 07:29:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 2902 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 07:29:38.090438 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-8f49b7cb-a5dd-4921-ada6-5730f3091a17 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:38.091302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-8f49b7cb-a5dd-4921-ada6-5730f3091a17 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:38.125035 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-551a506e-78bc-4e6b-9fba-05b8160833e6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:38.138155 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-551a506e-78bc-4e6b-9fba-05b8160833e6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1272 microversion: 2.1 time: 0.340781 Nov 02 07:29:38.158158 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 27/46] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:37 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1272 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:38.273949 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-8f49b7cb-a5dd-4921-ada6-5730f3091a17 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:38.294624 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-8f49b7cb-a5dd-4921-ada6-5730f3091a17 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:38.301386 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-8f49b7cb-a5dd-4921-ada6-5730f3091a17 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:38.307035 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-8f49b7cb-a5dd-4921-ada6-5730f3091a17 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1281 microversion: 2.20 time: 0.220310 Nov 02 07:29:38.310115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 20/47] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:29:38 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1281 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:29:38.432285 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-cd89bc6c-5f89-4104-89bf-2b71e38a6897 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:38.434273 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-cd89bc6c-5f89-4104-89bf-2b71e38a6897 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:38.453636 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd89bc6c-5f89-4104-89bf-2b71e38a6897 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:38.455346 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd89bc6c-5f89-4104-89bf-2b71e38a6897 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:38.461593 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd89bc6c-5f89-4104-89bf-2b71e38a6897 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:38.462902 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd89bc6c-5f89-4104-89bf-2b71e38a6897 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:38.463553 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd89bc6c-5f89-4104-89bf-2b71e38a6897 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:38.464348 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd89bc6c-5f89-4104-89bf-2b71e38a6897 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:39.172139 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7cc9957a-7873-42c4-b65c-379183c3c8e8 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:39.173914 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-7cc9957a-7873-42c4-b65c-379183c3c8e8 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:39.188033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7cc9957a-7873-42c4-b65c-379183c3c8e8 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:39.192923 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7cc9957a-7873-42c4-b65c-379183c3c8e8 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:39.229148 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7cc9957a-7873-42c4-b65c-379183c3c8e8 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:39.263012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7cc9957a-7873-42c4-b65c-379183c3c8e8 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:39.271239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7cc9957a-7873-42c4-b65c-379183c3c8e8 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:39.274385 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7cc9957a-7873-42c4-b65c-379183c3c8e8 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:39.639354 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-cd89bc6c-5f89-4104-89bf-2b71e38a6897 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:39.652297 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-cd89bc6c-5f89-4104-89bf-2b71e38a6897 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1282 microversion: 2.1 time: 1.222092 Nov 02 07:29:39.671227 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 28/48] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:38 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1282 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:39.694206 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-95f11a65-5e21-4c9a-8703-ab52b20e07d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:39.697870 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-95f11a65-5e21-4c9a-8703-ab52b20e07d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:39.720098 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-95f11a65-5e21-4c9a-8703-ab52b20e07d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:39.724571 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-95f11a65-5e21-4c9a-8703-ab52b20e07d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:39.725516 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-95f11a65-5e21-4c9a-8703-ab52b20e07d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:39.729487 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-95f11a65-5e21-4c9a-8703-ab52b20e07d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:39.730501 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-95f11a65-5e21-4c9a-8703-ab52b20e07d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:39.732344 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-95f11a65-5e21-4c9a-8703-ab52b20e07d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:39.942775 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-7cc9957a-7873-42c4-b65c-379183c3c8e8 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:39.972248 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-7cc9957a-7873-42c4-b65c-379183c3c8e8 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1272 microversion: 2.1 time: 0.805978 Nov 02 07:29:39.991876 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 21/49] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:39 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1272 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:40.021556 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-95f11a65-5e21-4c9a-8703-ab52b20e07d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:40.040187 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-95f11a65-5e21-4c9a-8703-ab52b20e07d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:40.052987 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-95f11a65-5e21-4c9a-8703-ab52b20e07d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:40.059403 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-95f11a65-5e21-4c9a-8703-ab52b20e07d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1277 microversion: 2.20 time: 0.384618 Nov 02 07:29:40.064838 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 29/50] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:29:39 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1277 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:29:40.692011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-fb8ce733-be11-4928-be7b-4b8db5b86823 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:40.693924 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-fb8ce733-be11-4928-be7b-4b8db5b86823 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:40.712987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fb8ce733-be11-4928-be7b-4b8db5b86823 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:40.715198 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fb8ce733-be11-4928-be7b-4b8db5b86823 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:40.716618 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fb8ce733-be11-4928-be7b-4b8db5b86823 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:40.720719 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fb8ce733-be11-4928-be7b-4b8db5b86823 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:40.721539 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fb8ce733-be11-4928-be7b-4b8db5b86823 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:40.722564 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fb8ce733-be11-4928-be7b-4b8db5b86823 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:41.009371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-66071dc5-56fa-416a-a3a4-91df07008c94 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:41.020662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-66071dc5-56fa-416a-a3a4-91df07008c94 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:41.031388 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66071dc5-56fa-416a-a3a4-91df07008c94 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:41.032093 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66071dc5-56fa-416a-a3a4-91df07008c94 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:41.032795 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66071dc5-56fa-416a-a3a4-91df07008c94 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:41.034398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66071dc5-56fa-416a-a3a4-91df07008c94 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:41.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66071dc5-56fa-416a-a3a4-91df07008c94 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:41.035784 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66071dc5-56fa-416a-a3a4-91df07008c94 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:41.145059 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fb8ce733-be11-4928-be7b-4b8db5b86823 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:41.163545 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-fb8ce733-be11-4928-be7b-4b8db5b86823 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1280 microversion: 2.1 time: 0.476676 Nov 02 07:29:41.179702 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 22/51] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:40 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1280 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:41.194606 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-aeed2d45-2477-4bf1-b4d0-2539f483f525 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:41.201959 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-aeed2d45-2477-4bf1-b4d0-2539f483f525 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:41.225826 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aeed2d45-2477-4bf1-b4d0-2539f483f525 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:41.232263 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aeed2d45-2477-4bf1-b4d0-2539f483f525 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:41.232999 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aeed2d45-2477-4bf1-b4d0-2539f483f525 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:41.233930 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aeed2d45-2477-4bf1-b4d0-2539f483f525 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:41.241090 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aeed2d45-2477-4bf1-b4d0-2539f483f525 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:41.242128 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aeed2d45-2477-4bf1-b4d0-2539f483f525 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:41.619121 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-aeed2d45-2477-4bf1-b4d0-2539f483f525 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:41.631519 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-aeed2d45-2477-4bf1-b4d0-2539f483f525 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:41.632987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-aeed2d45-2477-4bf1-b4d0-2539f483f525 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:41.634153 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-aeed2d45-2477-4bf1-b4d0-2539f483f525 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1333 microversion: 2.20 time: 0.453149 Nov 02 07:29:41.665051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 23/52] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:29:41 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1333 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:29:42.199509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7dfd2c99-4bc4-421b-a6be-11ffc9f5ccad tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:42.201477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-7dfd2c99-4bc4-421b-a6be-11ffc9f5ccad tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:42.220411 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7dfd2c99-4bc4-421b-a6be-11ffc9f5ccad tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:42.223010 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7dfd2c99-4bc4-421b-a6be-11ffc9f5ccad tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:42.231337 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7dfd2c99-4bc4-421b-a6be-11ffc9f5ccad tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:42.232274 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7dfd2c99-4bc4-421b-a6be-11ffc9f5ccad tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:42.232873 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7dfd2c99-4bc4-421b-a6be-11ffc9f5ccad tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:42.236840 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7dfd2c99-4bc4-421b-a6be-11ffc9f5ccad tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:42.877342 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-66071dc5-56fa-416a-a3a4-91df07008c94 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:42.887857 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-66071dc5-56fa-416a-a3a4-91df07008c94 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1314 microversion: 2.1 time: 1.884471 Nov 02 07:29:42.902724 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 30/53] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:41 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1314 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:42.907468 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2035c9fd-73d2-4911-bd60-9d482d82770d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:42.908038 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2035c9fd-73d2-4911-bd60-9d482d82770d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:42.926264 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2035c9fd-73d2-4911-bd60-9d482d82770d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:42.926800 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2035c9fd-73d2-4911-bd60-9d482d82770d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:42.927245 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2035c9fd-73d2-4911-bd60-9d482d82770d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:42.932226 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2035c9fd-73d2-4911-bd60-9d482d82770d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:42.932826 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2035c9fd-73d2-4911-bd60-9d482d82770d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:42.933748 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2035c9fd-73d2-4911-bd60-9d482d82770d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:42.934581 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-7dfd2c99-4bc4-421b-a6be-11ffc9f5ccad tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:42.947661 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-7dfd2c99-4bc4-421b-a6be-11ffc9f5ccad tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1280 microversion: 2.1 time: 0.752817 Nov 02 07:29:42.949141 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 24/54] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:42 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1280 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:29:43.055431 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=4 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:43.266902 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2035c9fd-73d2-4911-bd60-9d482d82770d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:43.281945 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2035c9fd-73d2-4911-bd60-9d482d82770d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:43.297187 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2035c9fd-73d2-4911-bd60-9d482d82770d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:43.302069 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2035c9fd-73d2-4911-bd60-9d482d82770d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1339 microversion: 2.20 time: 0.405530 Nov 02 07:29:43.322399 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 31/55] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:29:42 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1339 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:29:43.366315 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-8fcd8158-c718-47f0-b8e5-68fdc7c9f53f req-75a35b38-81e3-4cb8-b43f-e9abd8ea52e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "983e9075-27cf-4c74-bf6b-ff9fe8a68018", "tag": "0ee6dd20-0770-4e10-ac8f-d0e34d519f81"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:29:43.387434 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-8fcd8158-c718-47f0-b8e5-68fdc7c9f53f req-75a35b38-81e3-4cb8-b43f-e9abd8ea52e0 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:43.388413 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-8fcd8158-c718-47f0-b8e5-68fdc7c9f53f req-75a35b38-81e3-4cb8-b43f-e9abd8ea52e0 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:43.393507 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-8fcd8158-c718-47f0-b8e5-68fdc7c9f53f req-75a35b38-81e3-4cb8-b43f-e9abd8ea52e0 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:43.472618 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-8fcd8158-c718-47f0-b8e5-68fdc7c9f53f req-75a35b38-81e3-4cb8-b43f-e9abd8ea52e0 service nova] Creating event network-changed:0ee6dd20-0770-4e10-ac8f-d0e34d519f81 for instance 983e9075-27cf-4c74-bf6b-ff9fe8a68018 on hv-cinder-80473 Nov 02 07:29:43.476991 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-8fcd8158-c718-47f0-b8e5-68fdc7c9f53f req-75a35b38-81e3-4cb8-b43f-e9abd8ea52e0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118992) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 07:29:43.479471 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-8fcd8158-c718-47f0-b8e5-68fdc7c9f53f req-75a35b38-81e3-4cb8-b43f-e9abd8ea52e0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118992) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 07:29:43.484043 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9ef970b2-6681-4a7a-9a33-3e6da11ee746 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:43.485671 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9ef970b2-6681-4a7a-9a33-3e6da11ee746 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:43.488865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9ef970b2-6681-4a7a-9a33-3e6da11ee746 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:43.494324 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9ef970b2-6681-4a7a-9a33-3e6da11ee746 None None] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:43.496699 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9ef970b2-6681-4a7a-9a33-3e6da11ee746 None None] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:43.498784 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9ef970b2-6681-4a7a-9a33-3e6da11ee746 None None] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:43.545421 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.compute.rpcapi [None req-9ef970b2-6681-4a7a-9a33-3e6da11ee746 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 07:29:43.547882 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9ef970b2-6681-4a7a-9a33-3e6da11ee746 None None] Releasing lock "compute-rpcapi-router" {{(pid=118992) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 07:29:43.573211 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9ef970b2-6681-4a7a-9a33-3e6da11ee746 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.619509 Nov 02 07:29:43.574139 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 25/56] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:43.916327 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a78b6a48-54c9-4fb2-ae1b-d07551a5148e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:43.918940 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a78b6a48-54c9-4fb2-ae1b-d07551a5148e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:43.936791 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a78b6a48-54c9-4fb2-ae1b-d07551a5148e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:43.937471 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a78b6a48-54c9-4fb2-ae1b-d07551a5148e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:43.938231 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a78b6a48-54c9-4fb2-ae1b-d07551a5148e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:43.939234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a78b6a48-54c9-4fb2-ae1b-d07551a5148e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:43.942852 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a78b6a48-54c9-4fb2-ae1b-d07551a5148e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:43.954851 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a78b6a48-54c9-4fb2-ae1b-d07551a5148e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:43.976937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-bd7ce40e-65ca-4caf-9eeb-fde247deec59 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:43.977711 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-bd7ce40e-65ca-4caf-9eeb-fde247deec59 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:43.985224 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bd7ce40e-65ca-4caf-9eeb-fde247deec59 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:43.985714 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bd7ce40e-65ca-4caf-9eeb-fde247deec59 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:43.986154 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bd7ce40e-65ca-4caf-9eeb-fde247deec59 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:43.999001 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bd7ce40e-65ca-4caf-9eeb-fde247deec59 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:44.000246 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bd7ce40e-65ca-4caf-9eeb-fde247deec59 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:44.003891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bd7ce40e-65ca-4caf-9eeb-fde247deec59 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:45.024087 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-bd7ce40e-65ca-4caf-9eeb-fde247deec59 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:45.038779 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-bd7ce40e-65ca-4caf-9eeb-fde247deec59 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1322 microversion: 2.1 time: 1.063865 Nov 02 07:29:45.059555 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 26/57] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:43 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1322 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:45.071927 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-370e4d76-2ef2-46a5-9f78-b3d8bcba167f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:45.073782 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-370e4d76-2ef2-46a5-9f78-b3d8bcba167f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:45.095689 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-370e4d76-2ef2-46a5-9f78-b3d8bcba167f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:45.100816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-370e4d76-2ef2-46a5-9f78-b3d8bcba167f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:45.101593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-370e4d76-2ef2-46a5-9f78-b3d8bcba167f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:45.102640 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-370e4d76-2ef2-46a5-9f78-b3d8bcba167f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:45.103305 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-370e4d76-2ef2-46a5-9f78-b3d8bcba167f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:45.104488 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-370e4d76-2ef2-46a5-9f78-b3d8bcba167f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:45.263922 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-370e4d76-2ef2-46a5-9f78-b3d8bcba167f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:45.275063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-370e4d76-2ef2-46a5-9f78-b3d8bcba167f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:45.277084 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-370e4d76-2ef2-46a5-9f78-b3d8bcba167f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:45.278454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-370e4d76-2ef2-46a5-9f78-b3d8bcba167f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1339 microversion: 2.20 time: 0.214701 Nov 02 07:29:45.279019 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 27/58] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:29:45 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1339 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:29:45.306021 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=18 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:46.071739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f03087ec-ccb2-4aec-b1e9-2b0ba301bc57 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:46.074434 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f03087ec-ccb2-4aec-b1e9-2b0ba301bc57 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:46.088572 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f03087ec-ccb2-4aec-b1e9-2b0ba301bc57 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:46.091461 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f03087ec-ccb2-4aec-b1e9-2b0ba301bc57 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:46.091631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a78b6a48-54c9-4fb2-ae1b-d07551a5148e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:46.092233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f03087ec-ccb2-4aec-b1e9-2b0ba301bc57 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:46.092974 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f03087ec-ccb2-4aec-b1e9-2b0ba301bc57 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:46.093437 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f03087ec-ccb2-4aec-b1e9-2b0ba301bc57 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:46.093867 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f03087ec-ccb2-4aec-b1e9-2b0ba301bc57 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:46.105240 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a78b6a48-54c9-4fb2-ae1b-d07551a5148e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1314 microversion: 2.1 time: 2.192422 Nov 02 07:29:46.108277 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 32/59] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:43 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1314 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:29:46.281834 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-cde40e93-33a2-4c48-9658-2f2f46a91b82 req-fbf020d9-dbd6-4155-bfdc-4d0eb3d0b7c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5d6941-4c0e-4d53-94a7-70dcc586fbef", "tag": "1506af6f-e368-448b-aa78-a2c86ce9b462"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:29:46.349251 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-cde40e93-33a2-4c48-9658-2f2f46a91b82 req-fbf020d9-dbd6-4155-bfdc-4d0eb3d0b7c7 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:46.356114 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-cde40e93-33a2-4c48-9658-2f2f46a91b82 req-fbf020d9-dbd6-4155-bfdc-4d0eb3d0b7c7 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:46.357191 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-cde40e93-33a2-4c48-9658-2f2f46a91b82 req-fbf020d9-dbd6-4155-bfdc-4d0eb3d0b7c7 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:46.426675 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-cde40e93-33a2-4c48-9658-2f2f46a91b82 req-fbf020d9-dbd6-4155-bfdc-4d0eb3d0b7c7 service nova] Creating event network-changed:1506af6f-e368-448b-aa78-a2c86ce9b462 for instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef on hv-cinder-80473 Nov 02 07:29:46.439200 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-cde40e93-33a2-4c48-9658-2f2f46a91b82 req-fbf020d9-dbd6-4155-bfdc-4d0eb3d0b7c7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118991) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 07:29:46.440291 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-cde40e93-33a2-4c48-9658-2f2f46a91b82 req-fbf020d9-dbd6-4155-bfdc-4d0eb3d0b7c7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118991) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 07:29:46.441372 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e0055c46-2ebe-48e7-a070-517a2e7c4ed2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:46.448442 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e0055c46-2ebe-48e7-a070-517a2e7c4ed2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:46.449580 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e0055c46-2ebe-48e7-a070-517a2e7c4ed2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:46.450764 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e0055c46-2ebe-48e7-a070-517a2e7c4ed2 None None] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:46.451430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e0055c46-2ebe-48e7-a070-517a2e7c4ed2 None None] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:46.455074 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e0055c46-2ebe-48e7-a070-517a2e7c4ed2 None None] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:46.489239 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.compute.rpcapi [None req-e0055c46-2ebe-48e7-a070-517a2e7c4ed2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 07:29:46.490246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e0055c46-2ebe-48e7-a070-517a2e7c4ed2 None None] Releasing lock "compute-rpcapi-router" {{(pid=118991) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 07:29:46.537417 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e0055c46-2ebe-48e7-a070-517a2e7c4ed2 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261491 Nov 02 07:29:46.538557 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 33/60] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:46.554829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-4eca5a12-a1cf-41c6-91ee-1b0b8a981b32 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:46.555764 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-4eca5a12-a1cf-41c6-91ee-1b0b8a981b32 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:46.577241 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4eca5a12-a1cf-41c6-91ee-1b0b8a981b32 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:46.585006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4eca5a12-a1cf-41c6-91ee-1b0b8a981b32 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:46.586508 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4eca5a12-a1cf-41c6-91ee-1b0b8a981b32 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:46.590023 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4eca5a12-a1cf-41c6-91ee-1b0b8a981b32 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:46.592030 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4eca5a12-a1cf-41c6-91ee-1b0b8a981b32 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:46.594516 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4eca5a12-a1cf-41c6-91ee-1b0b8a981b32 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:46.959272 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-4eca5a12-a1cf-41c6-91ee-1b0b8a981b32 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:47.010108 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-4eca5a12-a1cf-41c6-91ee-1b0b8a981b32 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:47.021219 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-4eca5a12-a1cf-41c6-91ee-1b0b8a981b32 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:47.029759 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-4eca5a12-a1cf-41c6-91ee-1b0b8a981b32 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1339 microversion: 2.20 time: 0.486711 Nov 02 07:29:47.030509 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 34/61] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:29:46 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1339 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:29:47.145786 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ef604b4f-bd88-4477-b35c-9f47cf5f333b tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:47.146814 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-ef604b4f-bd88-4477-b35c-9f47cf5f333b tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:47.174019 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ef604b4f-bd88-4477-b35c-9f47cf5f333b tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:47.177600 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ef604b4f-bd88-4477-b35c-9f47cf5f333b tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:47.178068 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ef604b4f-bd88-4477-b35c-9f47cf5f333b tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:47.179002 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ef604b4f-bd88-4477-b35c-9f47cf5f333b tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:47.181105 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ef604b4f-bd88-4477-b35c-9f47cf5f333b tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:47.181674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ef604b4f-bd88-4477-b35c-9f47cf5f333b tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:47.481044 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f03087ec-ccb2-4aec-b1e9-2b0ba301bc57 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:47.490690 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f03087ec-ccb2-4aec-b1e9-2b0ba301bc57 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1322 microversion: 2.1 time: 1.422987 Nov 02 07:29:47.498393 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 28/62] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:46 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1322 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:29:47.795988 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ef604b4f-bd88-4477-b35c-9f47cf5f333b tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:47.822228 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ef604b4f-bd88-4477-b35c-9f47cf5f333b tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1314 microversion: 2.1 time: 0.691594 Nov 02 07:29:47.822908 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 35/63] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:47 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:48.060929 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-5140cdca-c83d-4356-a286-1f48d61cf2cb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:48.061543 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-5140cdca-c83d-4356-a286-1f48d61cf2cb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:48.072850 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5140cdca-c83d-4356-a286-1f48d61cf2cb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:48.075261 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5140cdca-c83d-4356-a286-1f48d61cf2cb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:48.075878 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5140cdca-c83d-4356-a286-1f48d61cf2cb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:48.076836 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5140cdca-c83d-4356-a286-1f48d61cf2cb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:48.077450 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5140cdca-c83d-4356-a286-1f48d61cf2cb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:48.078089 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5140cdca-c83d-4356-a286-1f48d61cf2cb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:48.279493 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=20 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:48.519265 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-349ff88a-bdfd-4294-87cc-d01affca0779 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:48.520202 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-349ff88a-bdfd-4294-87cc-d01affca0779 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:48.532260 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-349ff88a-bdfd-4294-87cc-d01affca0779 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:48.533563 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-349ff88a-bdfd-4294-87cc-d01affca0779 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:48.534728 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-349ff88a-bdfd-4294-87cc-d01affca0779 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:48.536202 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-349ff88a-bdfd-4294-87cc-d01affca0779 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:48.545679 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-349ff88a-bdfd-4294-87cc-d01affca0779 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:48.547008 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-349ff88a-bdfd-4294-87cc-d01affca0779 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:48.687724 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-5140cdca-c83d-4356-a286-1f48d61cf2cb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:48.705630 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-5140cdca-c83d-4356-a286-1f48d61cf2cb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:48.707721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-5140cdca-c83d-4356-a286-1f48d61cf2cb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:48.712193 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-5140cdca-c83d-4356-a286-1f48d61cf2cb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1407 microversion: 2.20 time: 0.654823 Nov 02 07:29:48.714875 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 29/64] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:29:48 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1407 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:29:48.849600 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-536a14b3-584f-448e-aa25-3c5b5a49b7f2 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:48.850501 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-536a14b3-584f-448e-aa25-3c5b5a49b7f2 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:48.861155 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-536a14b3-584f-448e-aa25-3c5b5a49b7f2 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:48.862627 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-536a14b3-584f-448e-aa25-3c5b5a49b7f2 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:48.863093 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-536a14b3-584f-448e-aa25-3c5b5a49b7f2 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:48.863810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-536a14b3-584f-448e-aa25-3c5b5a49b7f2 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:48.865350 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-536a14b3-584f-448e-aa25-3c5b5a49b7f2 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:48.865805 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-536a14b3-584f-448e-aa25-3c5b5a49b7f2 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:48.905792 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-349ff88a-bdfd-4294-87cc-d01affca0779 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:48.919346 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-349ff88a-bdfd-4294-87cc-d01affca0779 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1322 microversion: 2.1 time: 0.405303 Nov 02 07:29:48.926108 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 36/65] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:48 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:49.174399 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-536a14b3-584f-448e-aa25-3c5b5a49b7f2 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:49.184040 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-536a14b3-584f-448e-aa25-3c5b5a49b7f2 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1314 microversion: 2.1 time: 0.339894 Nov 02 07:29:49.185211 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 30/66] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:48 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:49.744559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-66da76d9-032f-4ff8-a13d-7ab0937dafe0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:49.746459 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-66da76d9-032f-4ff8-a13d-7ab0937dafe0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:49.753154 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-66da76d9-032f-4ff8-a13d-7ab0937dafe0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:49.754324 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-66da76d9-032f-4ff8-a13d-7ab0937dafe0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:49.755262 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-66da76d9-032f-4ff8-a13d-7ab0937dafe0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:49.756360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-66da76d9-032f-4ff8-a13d-7ab0937dafe0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:49.757001 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-66da76d9-032f-4ff8-a13d-7ab0937dafe0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:49.757659 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-66da76d9-032f-4ff8-a13d-7ab0937dafe0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:49.758554 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-598a5aaf-8361-4e9a-81da-2a673da9ab23 req-5833ab72-81ef-42f9-9cb6-0c5a6a904bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "684b9aec-ddff-4c9c-9c18-957a432b3c17", "tag": "3c1f0233-b78d-4abc-80ac-644aeafb4656"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:29:49.774581 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-598a5aaf-8361-4e9a-81da-2a673da9ab23 req-5833ab72-81ef-42f9-9cb6-0c5a6a904bb6 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:49.775064 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-598a5aaf-8361-4e9a-81da-2a673da9ab23 req-5833ab72-81ef-42f9-9cb6-0c5a6a904bb6 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:49.775490 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-598a5aaf-8361-4e9a-81da-2a673da9ab23 req-5833ab72-81ef-42f9-9cb6-0c5a6a904bb6 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:49.804351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-598a5aaf-8361-4e9a-81da-2a673da9ab23 req-5833ab72-81ef-42f9-9cb6-0c5a6a904bb6 service nova] Creating event network-changed:3c1f0233-b78d-4abc-80ac-644aeafb4656 for instance 684b9aec-ddff-4c9c-9c18-957a432b3c17 on hv-cinder-80473 Nov 02 07:29:49.822288 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-598a5aaf-8361-4e9a-81da-2a673da9ab23 req-5833ab72-81ef-42f9-9cb6-0c5a6a904bb6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.380415 Nov 02 07:29:49.834318 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 37/67] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:49.944939 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0e4c3029-faee-42fd-8e26-170ab22d7f19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:49.946587 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-0e4c3029-faee-42fd-8e26-170ab22d7f19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:49.960206 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0e4c3029-faee-42fd-8e26-170ab22d7f19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:49.960692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0e4c3029-faee-42fd-8e26-170ab22d7f19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:49.961126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0e4c3029-faee-42fd-8e26-170ab22d7f19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:49.961831 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0e4c3029-faee-42fd-8e26-170ab22d7f19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:49.967549 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0e4c3029-faee-42fd-8e26-170ab22d7f19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:49.968965 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0e4c3029-faee-42fd-8e26-170ab22d7f19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:50.034591 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-66da76d9-032f-4ff8-a13d-7ab0937dafe0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:50.047045 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-66da76d9-032f-4ff8-a13d-7ab0937dafe0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:50.051928 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-66da76d9-032f-4ff8-a13d-7ab0937dafe0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:50.055479 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-66da76d9-032f-4ff8-a13d-7ab0937dafe0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1407 microversion: 2.20 time: 0.315465 Nov 02 07:29:50.056460 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 31/68] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:29:49 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:29:50.210613 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-423bdd75-c40d-4574-ad8d-6ba4dc09c179 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:50.211512 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-423bdd75-c40d-4574-ad8d-6ba4dc09c179 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:50.233760 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-423bdd75-c40d-4574-ad8d-6ba4dc09c179 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:50.234294 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-423bdd75-c40d-4574-ad8d-6ba4dc09c179 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:50.234866 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-423bdd75-c40d-4574-ad8d-6ba4dc09c179 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:50.235672 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-423bdd75-c40d-4574-ad8d-6ba4dc09c179 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:50.236131 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-423bdd75-c40d-4574-ad8d-6ba4dc09c179 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:50.236553 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-423bdd75-c40d-4574-ad8d-6ba4dc09c179 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:50.258784 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0e4c3029-faee-42fd-8e26-170ab22d7f19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:50.272101 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0e4c3029-faee-42fd-8e26-170ab22d7f19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1322 microversion: 2.1 time: 0.329869 Nov 02 07:29:50.274517 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 38/69] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:49 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:50.419112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-423bdd75-c40d-4574-ad8d-6ba4dc09c179 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:50.427730 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-423bdd75-c40d-4574-ad8d-6ba4dc09c179 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1314 microversion: 2.1 time: 0.222317 Nov 02 07:29:50.428474 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 32/70] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:50 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:29:51.085451 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-e8a34c71-c5bf-4ddf-b58e-a8402ffba8f3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:51.086716 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-e8a34c71-c5bf-4ddf-b58e-a8402ffba8f3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:51.095770 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e8a34c71-c5bf-4ddf-b58e-a8402ffba8f3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:51.096428 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e8a34c71-c5bf-4ddf-b58e-a8402ffba8f3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:51.097157 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e8a34c71-c5bf-4ddf-b58e-a8402ffba8f3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:51.098126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e8a34c71-c5bf-4ddf-b58e-a8402ffba8f3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:51.098819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e8a34c71-c5bf-4ddf-b58e-a8402ffba8f3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:51.099380 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e8a34c71-c5bf-4ddf-b58e-a8402ffba8f3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:51.303647 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-870933a1-8fb6-42a0-803f-6d38256bcc07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:51.305469 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-870933a1-8fb6-42a0-803f-6d38256bcc07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:51.320108 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-870933a1-8fb6-42a0-803f-6d38256bcc07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:51.320606 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-870933a1-8fb6-42a0-803f-6d38256bcc07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:51.321044 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-870933a1-8fb6-42a0-803f-6d38256bcc07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:51.324574 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-870933a1-8fb6-42a0-803f-6d38256bcc07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:51.327927 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-870933a1-8fb6-42a0-803f-6d38256bcc07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:51.330103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-870933a1-8fb6-42a0-803f-6d38256bcc07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:51.363382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e8a34c71-c5bf-4ddf-b58e-a8402ffba8f3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:51.376047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e8a34c71-c5bf-4ddf-b58e-a8402ffba8f3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:51.383662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e8a34c71-c5bf-4ddf-b58e-a8402ffba8f3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:51.388755 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e8a34c71-c5bf-4ddf-b58e-a8402ffba8f3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1407 microversion: 2.20 time: 0.306551 Nov 02 07:29:51.392144 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 39/71] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:29:51 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:29:51.454341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-471c48d3-6cdd-469e-a5a1-dba2c99fc038 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:51.456720 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-471c48d3-6cdd-469e-a5a1-dba2c99fc038 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:51.465041 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-471c48d3-6cdd-469e-a5a1-dba2c99fc038 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:51.465532 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-471c48d3-6cdd-469e-a5a1-dba2c99fc038 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:51.466888 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-471c48d3-6cdd-469e-a5a1-dba2c99fc038 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:51.468025 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-471c48d3-6cdd-469e-a5a1-dba2c99fc038 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:51.468697 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-471c48d3-6cdd-469e-a5a1-dba2c99fc038 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:51.470071 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-471c48d3-6cdd-469e-a5a1-dba2c99fc038 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:51.677941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-870933a1-8fb6-42a0-803f-6d38256bcc07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:51.693661 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-870933a1-8fb6-42a0-803f-6d38256bcc07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1322 microversion: 2.1 time: 0.399130 Nov 02 07:29:51.714937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 33/72] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:51 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:29:51.891031 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-471c48d3-6cdd-469e-a5a1-dba2c99fc038 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:51.905888 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-471c48d3-6cdd-469e-a5a1-dba2c99fc038 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1314 microversion: 2.1 time: 0.455668 Nov 02 07:29:51.907266 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 40/73] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:51 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:52.414812 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6124fd65-2982-4504-9880-3d446c6e007b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:52.416230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-6124fd65-2982-4504-9880-3d446c6e007b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:52.435882 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6124fd65-2982-4504-9880-3d446c6e007b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:52.436818 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6124fd65-2982-4504-9880-3d446c6e007b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:52.437381 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6124fd65-2982-4504-9880-3d446c6e007b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:52.438103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6124fd65-2982-4504-9880-3d446c6e007b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:52.441800 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6124fd65-2982-4504-9880-3d446c6e007b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:52.442481 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6124fd65-2982-4504-9880-3d446c6e007b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:52.669289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-f63901a5-6540-4569-95a1-03ff43b62c95 req-63d8a45b-cda2-4262-8641-61625a0f86bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae04f42-6d0d-42e5-ae5f-8022b6f546df", "tag": "ba58ff3d-570b-447a-86ec-a6d9a70152fc"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:29:52.681026 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:52.686610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-f63901a5-6540-4569-95a1-03ff43b62c95 req-63d8a45b-cda2-4262-8641-61625a0f86bb service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:52.687137 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-f63901a5-6540-4569-95a1-03ff43b62c95 req-63d8a45b-cda2-4262-8641-61625a0f86bb service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:52.687584 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-f63901a5-6540-4569-95a1-03ff43b62c95 req-63d8a45b-cda2-4262-8641-61625a0f86bb service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:52.691926 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=95 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:52.728677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-f63901a5-6540-4569-95a1-03ff43b62c95 req-63d8a45b-cda2-4262-8641-61625a0f86bb service nova] Creating event network-changed:ba58ff3d-570b-447a-86ec-a6d9a70152fc for instance cae04f42-6d0d-42e5-ae5f-8022b6f546df on hv-cinder-80473 Nov 02 07:29:52.728677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-f63901a5-6540-4569-95a1-03ff43b62c95 req-63d8a45b-cda2-4262-8641-61625a0f86bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062953 Nov 02 07:29:52.729910 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 41/74] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:52.737597 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-02692906-3a5f-4f90-98e4-974f326d429a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:52.738309 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-02692906-3a5f-4f90-98e4-974f326d429a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:52.755425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-02692906-3a5f-4f90-98e4-974f326d429a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:52.756146 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-02692906-3a5f-4f90-98e4-974f326d429a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:52.756757 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-02692906-3a5f-4f90-98e4-974f326d429a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:52.757616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-02692906-3a5f-4f90-98e4-974f326d429a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:52.758220 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-02692906-3a5f-4f90-98e4-974f326d429a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:52.759588 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-02692906-3a5f-4f90-98e4-974f326d429a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:53.001034 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-6124fd65-2982-4504-9880-3d446c6e007b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:53.009582 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-6124fd65-2982-4504-9880-3d446c6e007b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:53.011198 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-6124fd65-2982-4504-9880-3d446c6e007b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:53.012248 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-6124fd65-2982-4504-9880-3d446c6e007b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1407 microversion: 2.20 time: 0.601925 Nov 02 07:29:53.012776 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 34/75] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:29:52 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1407 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:29:53.033820 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-fff4ed9e-f5c8-491b-b8ae-de7e0d609a83 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:53.035186 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-fff4ed9e-f5c8-491b-b8ae-de7e0d609a83 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:53.051327 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fff4ed9e-f5c8-491b-b8ae-de7e0d609a83 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:53.051741 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fff4ed9e-f5c8-491b-b8ae-de7e0d609a83 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:53.052184 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fff4ed9e-f5c8-491b-b8ae-de7e0d609a83 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:53.052891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fff4ed9e-f5c8-491b-b8ae-de7e0d609a83 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:53.053344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fff4ed9e-f5c8-491b-b8ae-de7e0d609a83 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:53.053929 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fff4ed9e-f5c8-491b-b8ae-de7e0d609a83 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:53.146573 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-02692906-3a5f-4f90-98e4-974f326d429a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:53.163125 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-02692906-3a5f-4f90-98e4-974f326d429a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1322 microversion: 2.1 time: 0.431941 Nov 02 07:29:53.163990 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 42/76] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:52 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:53.293733 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fff4ed9e-f5c8-491b-b8ae-de7e0d609a83 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:53.306481 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-fff4ed9e-f5c8-491b-b8ae-de7e0d609a83 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1314 microversion: 2.1 time: 0.283412 Nov 02 07:29:53.324799 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 35/77] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:53 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:54.037844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-1063611f-8398-49de-b4e1-3683a792a1f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:54.038558 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-1063611f-8398-49de-b4e1-3683a792a1f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:54.044971 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1063611f-8398-49de-b4e1-3683a792a1f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:54.045529 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1063611f-8398-49de-b4e1-3683a792a1f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:54.046708 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1063611f-8398-49de-b4e1-3683a792a1f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:54.046831 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1063611f-8398-49de-b4e1-3683a792a1f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:54.047280 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1063611f-8398-49de-b4e1-3683a792a1f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:54.047701 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1063611f-8398-49de-b4e1-3683a792a1f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:54.188864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ddf7ebbf-7153-491e-bf1c-b1504aff02d3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:54.189568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ddf7ebbf-7153-491e-bf1c-b1504aff02d3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:54.199752 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=6 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:54.201317 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ddf7ebbf-7153-491e-bf1c-b1504aff02d3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:54.201873 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ddf7ebbf-7153-491e-bf1c-b1504aff02d3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:54.202328 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ddf7ebbf-7153-491e-bf1c-b1504aff02d3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:54.203097 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ddf7ebbf-7153-491e-bf1c-b1504aff02d3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:54.203642 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ddf7ebbf-7153-491e-bf1c-b1504aff02d3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:54.204040 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ddf7ebbf-7153-491e-bf1c-b1504aff02d3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:54.220916 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-1063611f-8398-49de-b4e1-3683a792a1f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:54.234336 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-1063611f-8398-49de-b4e1-3683a792a1f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:54.235796 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-1063611f-8398-49de-b4e1-3683a792a1f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:54.236930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-1063611f-8398-49de-b4e1-3683a792a1f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1407 microversion: 2.20 time: 0.203617 Nov 02 07:29:54.237487 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 43/78] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:29:54 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:29:54.335732 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-fc7017a5-695f-48ad-a34f-a916cd16bebd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:54.336880 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-fc7017a5-695f-48ad-a34f-a916cd16bebd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:54.345177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fc7017a5-695f-48ad-a34f-a916cd16bebd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:54.345822 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fc7017a5-695f-48ad-a34f-a916cd16bebd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:54.346455 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fc7017a5-695f-48ad-a34f-a916cd16bebd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:54.347277 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fc7017a5-695f-48ad-a34f-a916cd16bebd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:54.347858 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fc7017a5-695f-48ad-a34f-a916cd16bebd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:54.348571 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fc7017a5-695f-48ad-a34f-a916cd16bebd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:54.418710 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ddf7ebbf-7153-491e-bf1c-b1504aff02d3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:54.434422 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ddf7ebbf-7153-491e-bf1c-b1504aff02d3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1322 microversion: 2.1 time: 0.247434 Nov 02 07:29:54.442502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 36/79] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:54 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:29:54.572899 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-fc7017a5-695f-48ad-a34f-a916cd16bebd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:54.585103 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-fc7017a5-695f-48ad-a34f-a916cd16bebd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1314 microversion: 2.1 time: 0.254330 Nov 02 07:29:54.586562 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 44/80] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:54 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:55.280051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-14c8fdec-4e09-4cf0-aab5-006522890ee8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:55.280612 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-14c8fdec-4e09-4cf0-aab5-006522890ee8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:55.283556 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:55.295738 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-14c8fdec-4e09-4cf0-aab5-006522890ee8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:55.296622 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-14c8fdec-4e09-4cf0-aab5-006522890ee8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:55.297322 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-14c8fdec-4e09-4cf0-aab5-006522890ee8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:55.298450 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-14c8fdec-4e09-4cf0-aab5-006522890ee8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:55.300199 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-14c8fdec-4e09-4cf0-aab5-006522890ee8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:55.301145 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-14c8fdec-4e09-4cf0-aab5-006522890ee8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:55.366562 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=100 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:55.460300 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8b39ae80-33c8-4d6a-b98d-c455f6045d07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:55.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8b39ae80-33c8-4d6a-b98d-c455f6045d07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:55.468465 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b39ae80-33c8-4d6a-b98d-c455f6045d07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:55.469102 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b39ae80-33c8-4d6a-b98d-c455f6045d07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:55.469562 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b39ae80-33c8-4d6a-b98d-c455f6045d07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:55.470349 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b39ae80-33c8-4d6a-b98d-c455f6045d07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:55.470839 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b39ae80-33c8-4d6a-b98d-c455f6045d07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:55.471227 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b39ae80-33c8-4d6a-b98d-c455f6045d07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:55.591459 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-14c8fdec-4e09-4cf0-aab5-006522890ee8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:55.601005 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-14c8fdec-4e09-4cf0-aab5-006522890ee8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:55.602820 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-14c8fdec-4e09-4cf0-aab5-006522890ee8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:55.604165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-14c8fdec-4e09-4cf0-aab5-006522890ee8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1407 microversion: 2.20 time: 0.343575 Nov 02 07:29:55.605486 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 37/81] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:29:55 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:29:55.609725 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1c13848a-5a98-4b69-9ccd-dd401e2433a3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:55.610585 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1c13848a-5a98-4b69-9ccd-dd401e2433a3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:55.619736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1c13848a-5a98-4b69-9ccd-dd401e2433a3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:55.619736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1c13848a-5a98-4b69-9ccd-dd401e2433a3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:55.619736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1c13848a-5a98-4b69-9ccd-dd401e2433a3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:55.632606 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1c13848a-5a98-4b69-9ccd-dd401e2433a3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:55.632984 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1c13848a-5a98-4b69-9ccd-dd401e2433a3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:55.633413 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1c13848a-5a98-4b69-9ccd-dd401e2433a3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:55.744524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8b39ae80-33c8-4d6a-b98d-c455f6045d07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:55.761430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8b39ae80-33c8-4d6a-b98d-c455f6045d07 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1322 microversion: 2.1 time: 0.305416 Nov 02 07:29:55.762055 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 45/82] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:55 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:29:55.811722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1c13848a-5a98-4b69-9ccd-dd401e2433a3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:55.820587 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-1c13848a-5a98-4b69-9ccd-dd401e2433a3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1314 microversion: 2.1 time: 0.214471 Nov 02 07:29:55.821517 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 38/83] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:55 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:56.630291 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-543481e9-2c49-412c-8688-44916b7e05bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:56.630932 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-543481e9-2c49-412c-8688-44916b7e05bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:56.633004 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:29:56.639116 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-543481e9-2c49-412c-8688-44916b7e05bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:56.639596 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-543481e9-2c49-412c-8688-44916b7e05bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:56.640020 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-543481e9-2c49-412c-8688-44916b7e05bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:56.640865 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-543481e9-2c49-412c-8688-44916b7e05bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:56.641458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-543481e9-2c49-412c-8688-44916b7e05bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:56.642022 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-543481e9-2c49-412c-8688-44916b7e05bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:56.785536 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-fe9e99fa-6957-410c-b657-ca21a30109b6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:56.786579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-fe9e99fa-6957-410c-b657-ca21a30109b6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:56.795113 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fe9e99fa-6957-410c-b657-ca21a30109b6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:56.795113 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fe9e99fa-6957-410c-b657-ca21a30109b6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:56.795113 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fe9e99fa-6957-410c-b657-ca21a30109b6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:56.795113 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fe9e99fa-6957-410c-b657-ca21a30109b6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:56.796607 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fe9e99fa-6957-410c-b657-ca21a30109b6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:56.797203 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fe9e99fa-6957-410c-b657-ca21a30109b6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:56.930925 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-543481e9-2c49-412c-8688-44916b7e05bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:56.944965 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-543481e9-2c49-412c-8688-44916b7e05bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:56.946342 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-543481e9-2c49-412c-8688-44916b7e05bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:56.947600 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-543481e9-2c49-412c-8688-44916b7e05bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1407 microversion: 2.20 time: 0.321165 Nov 02 07:29:56.962325 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 46/84] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:29:56 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1407 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:29:56.968690 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d878d135-2638-48e9-a870-b55466823078 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:56.969395 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-d878d135-2638-48e9-a870-b55466823078 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:56.975631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d878d135-2638-48e9-a870-b55466823078 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:56.976114 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d878d135-2638-48e9-a870-b55466823078 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:56.976541 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d878d135-2638-48e9-a870-b55466823078 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:56.977229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d878d135-2638-48e9-a870-b55466823078 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:56.977610 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fe9e99fa-6957-410c-b657-ca21a30109b6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:56.977723 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d878d135-2638-48e9-a870-b55466823078 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:56.978111 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d878d135-2638-48e9-a870-b55466823078 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:56.985933 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-fe9e99fa-6957-410c-b657-ca21a30109b6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1322 microversion: 2.1 time: 0.205478 Nov 02 07:29:56.986558 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 39/85] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:56 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:29:57.120239 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d878d135-2638-48e9-a870-b55466823078 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:57.127970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d878d135-2638-48e9-a870-b55466823078 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1314 microversion: 2.1 time: 0.163727 Nov 02 07:29:57.128539 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 47/86] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:56 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:57.972627 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-08a1fd34-9774-4c4e-abbe-6abcd9768d09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:57.973233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-08a1fd34-9774-4c4e-abbe-6abcd9768d09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:57.979205 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-08a1fd34-9774-4c4e-abbe-6abcd9768d09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:57.980314 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-08a1fd34-9774-4c4e-abbe-6abcd9768d09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:57.980741 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-08a1fd34-9774-4c4e-abbe-6abcd9768d09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:57.981418 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-08a1fd34-9774-4c4e-abbe-6abcd9768d09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:57.981863 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-08a1fd34-9774-4c4e-abbe-6abcd9768d09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:57.982280 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-08a1fd34-9774-4c4e-abbe-6abcd9768d09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:58.012361 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8a4c45e5-333f-49dd-a499-9b1c621a4dc3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:58.013184 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8a4c45e5-333f-49dd-a499-9b1c621a4dc3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:58.019621 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8a4c45e5-333f-49dd-a499-9b1c621a4dc3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:58.020134 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8a4c45e5-333f-49dd-a499-9b1c621a4dc3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:58.020586 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8a4c45e5-333f-49dd-a499-9b1c621a4dc3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:58.021310 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8a4c45e5-333f-49dd-a499-9b1c621a4dc3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:58.021760 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8a4c45e5-333f-49dd-a499-9b1c621a4dc3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:58.022175 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8a4c45e5-333f-49dd-a499-9b1c621a4dc3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:58.197151 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-08a1fd34-9774-4c4e-abbe-6abcd9768d09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:58.206266 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-08a1fd34-9774-4c4e-abbe-6abcd9768d09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:58.207731 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-08a1fd34-9774-4c4e-abbe-6abcd9768d09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:58.209335 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-08a1fd34-9774-4c4e-abbe-6abcd9768d09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1407 microversion: 2.20 time: 0.240128 Nov 02 07:29:58.209896 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 40/87] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:29:57 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:29:58.214932 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-5a66437e-12cb-45a9-bec0-f982224804fd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:58.215542 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-5a66437e-12cb-45a9-bec0-f982224804fd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:58.221530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5a66437e-12cb-45a9-bec0-f982224804fd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:58.222047 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5a66437e-12cb-45a9-bec0-f982224804fd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:58.222582 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5a66437e-12cb-45a9-bec0-f982224804fd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:58.223427 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5a66437e-12cb-45a9-bec0-f982224804fd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:58.223925 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5a66437e-12cb-45a9-bec0-f982224804fd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:58.224348 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5a66437e-12cb-45a9-bec0-f982224804fd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:58.228808 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8a4c45e5-333f-49dd-a499-9b1c621a4dc3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:58.237738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8a4c45e5-333f-49dd-a499-9b1c621a4dc3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1322 microversion: 2.1 time: 0.229448 Nov 02 07:29:58.238614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 48/88] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:58 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:58.316196 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-cfa7ed6b-0563-4f20-b9b4-c1a2dd13b46d req-0fd33020-d134-4305-b277-57bd82099252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983e9075-27cf-4c74-bf6b-ff9fe8a68018", "name": "network-vif-plugged", "status": "completed", "tag": "0ee6dd20-0770-4e10-ac8f-d0e34d519f81"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:29:58.326767 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-cfa7ed6b-0563-4f20-b9b4-c1a2dd13b46d req-0fd33020-d134-4305-b277-57bd82099252 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:58.327246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-cfa7ed6b-0563-4f20-b9b4-c1a2dd13b46d req-0fd33020-d134-4305-b277-57bd82099252 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:58.327666 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-cfa7ed6b-0563-4f20-b9b4-c1a2dd13b46d req-0fd33020-d134-4305-b277-57bd82099252 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:58.341278 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-cfa7ed6b-0563-4f20-b9b4-c1a2dd13b46d req-0fd33020-d134-4305-b277-57bd82099252 service nova] Creating event network-vif-plugged:0ee6dd20-0770-4e10-ac8f-d0e34d519f81 for instance 983e9075-27cf-4c74-bf6b-ff9fe8a68018 on hv-cinder-80473 Nov 02 07:29:58.346587 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-cfa7ed6b-0563-4f20-b9b4-c1a2dd13b46d req-0fd33020-d134-4305-b277-57bd82099252 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106610 Nov 02 07:29:58.347207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 49/89] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:29:58.369229 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-5a66437e-12cb-45a9-bec0-f982224804fd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:58.378989 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-5a66437e-12cb-45a9-bec0-f982224804fd tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1314 microversion: 2.1 time: 0.168070 Nov 02 07:29:58.379562 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 41/90] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:58 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:29:59.236357 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-df2b47c1-a387-4a7c-befb-e23023248d1e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:59.238391 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-df2b47c1-a387-4a7c-befb-e23023248d1e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:59.243725 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df2b47c1-a387-4a7c-befb-e23023248d1e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:59.244206 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df2b47c1-a387-4a7c-befb-e23023248d1e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:59.244634 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df2b47c1-a387-4a7c-befb-e23023248d1e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:59.246041 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df2b47c1-a387-4a7c-befb-e23023248d1e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:59.246848 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df2b47c1-a387-4a7c-befb-e23023248d1e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:59.247299 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df2b47c1-a387-4a7c-befb-e23023248d1e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:59.264603 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3edbac0f-1bce-4ef7-881a-af347b812316 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:59.265216 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3edbac0f-1bce-4ef7-881a-af347b812316 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:59.272298 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3edbac0f-1bce-4ef7-881a-af347b812316 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:59.278748 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3edbac0f-1bce-4ef7-881a-af347b812316 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:59.279394 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3edbac0f-1bce-4ef7-881a-af347b812316 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:59.280478 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3edbac0f-1bce-4ef7-881a-af347b812316 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:59.281118 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3edbac0f-1bce-4ef7-881a-af347b812316 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:59.281728 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3edbac0f-1bce-4ef7-881a-af347b812316 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:59.527160 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-df2b47c1-a387-4a7c-befb-e23023248d1e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:59.545034 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-df2b47c1-a387-4a7c-befb-e23023248d1e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:59.547820 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-df2b47c1-a387-4a7c-befb-e23023248d1e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:59.548962 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-df2b47c1-a387-4a7c-befb-e23023248d1e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1407 microversion: 2.20 time: 0.316948 Nov 02 07:29:59.549577 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 50/91] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:29:59 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:29:59.558771 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3edbac0f-1bce-4ef7-881a-af347b812316 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:59.570907 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-e87d0b18-78d8-4630-91ce-65f2855cba35 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:29:59.571879 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-e87d0b18-78d8-4630-91ce-65f2855cba35 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:29:59.574289 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3edbac0f-1bce-4ef7-881a-af347b812316 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1322 microversion: 2.1 time: 0.313779 Nov 02 07:29:59.575108 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 42/92] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:59 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:29:59.580159 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e87d0b18-78d8-4630-91ce-65f2855cba35 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:59.580871 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e87d0b18-78d8-4630-91ce-65f2855cba35 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:59.581911 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e87d0b18-78d8-4630-91ce-65f2855cba35 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:59.582859 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e87d0b18-78d8-4630-91ce-65f2855cba35 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:29:59.584212 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e87d0b18-78d8-4630-91ce-65f2855cba35 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:29:59.585033 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e87d0b18-78d8-4630-91ce-65f2855cba35 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:29:59.780085 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e87d0b18-78d8-4630-91ce-65f2855cba35 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:29:59.792561 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e87d0b18-78d8-4630-91ce-65f2855cba35 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1314 microversion: 2.1 time: 0.241571 Nov 02 07:29:59.793669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 51/93] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:29:59 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:00.368891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-20d37497-6f05-4ce1-a5aa-039c6df892b4 req-6e8c5030-5f3f-4a86-bfdb-169a3a424d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5d6941-4c0e-4d53-94a7-70dcc586fbef", "name": "network-vif-plugged", "status": "completed", "tag": "1506af6f-e368-448b-aa78-a2c86ce9b462"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:30:00.389422 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-20d37497-6f05-4ce1-a5aa-039c6df892b4 req-6e8c5030-5f3f-4a86-bfdb-169a3a424d27 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:00.389901 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-20d37497-6f05-4ce1-a5aa-039c6df892b4 req-6e8c5030-5f3f-4a86-bfdb-169a3a424d27 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:00.390330 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-20d37497-6f05-4ce1-a5aa-039c6df892b4 req-6e8c5030-5f3f-4a86-bfdb-169a3a424d27 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:00.413441 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-20d37497-6f05-4ce1-a5aa-039c6df892b4 req-6e8c5030-5f3f-4a86-bfdb-169a3a424d27 service nova] Creating event network-vif-plugged:1506af6f-e368-448b-aa78-a2c86ce9b462 for instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef on hv-cinder-80473 Nov 02 07:30:00.420581 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-20d37497-6f05-4ce1-a5aa-039c6df892b4 req-6e8c5030-5f3f-4a86-bfdb-169a3a424d27 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057701 Nov 02 07:30:00.422172 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 43/94] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:30:00.579883 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-7346daec-fa3c-4ff5-8b59-8be150a9c655 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:00.580849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-7346daec-fa3c-4ff5-8b59-8be150a9c655 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:00.592423 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7346daec-fa3c-4ff5-8b59-8be150a9c655 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:00.593756 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7346daec-fa3c-4ff5-8b59-8be150a9c655 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:00.594652 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7346daec-fa3c-4ff5-8b59-8be150a9c655 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:00.595945 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7346daec-fa3c-4ff5-8b59-8be150a9c655 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:00.596800 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7346daec-fa3c-4ff5-8b59-8be150a9c655 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:00.597861 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7346daec-fa3c-4ff5-8b59-8be150a9c655 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:00.598129 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-4e3db49d-cc50-42bc-a831-e22806666918 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:00.599188 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-4e3db49d-cc50-42bc-a831-e22806666918 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:00.609907 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4e3db49d-cc50-42bc-a831-e22806666918 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:00.610422 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4e3db49d-cc50-42bc-a831-e22806666918 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:00.610853 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4e3db49d-cc50-42bc-a831-e22806666918 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:00.611710 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4e3db49d-cc50-42bc-a831-e22806666918 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:00.613725 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4e3db49d-cc50-42bc-a831-e22806666918 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:00.614856 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4e3db49d-cc50-42bc-a831-e22806666918 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:00.960009 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7346daec-fa3c-4ff5-8b59-8be150a9c655 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:00.977107 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7346daec-fa3c-4ff5-8b59-8be150a9c655 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:00.983790 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7346daec-fa3c-4ff5-8b59-8be150a9c655 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:00.985066 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-7346daec-fa3c-4ff5-8b59-8be150a9c655 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1407 microversion: 2.20 time: 0.412823 Nov 02 07:30:00.986060 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-4e3db49d-cc50-42bc-a831-e22806666918 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:00.986514 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 52/95] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:30:00 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:30:00.998600 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-4e3db49d-cc50-42bc-a831-e22806666918 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1322 microversion: 2.1 time: 0.404927 Nov 02 07:30:01.001565 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-3344db11-f6ff-45ea-9daf-4cb66b746363 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:01.002479 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-3344db11-f6ff-45ea-9daf-4cb66b746363 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:01.010061 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3344db11-f6ff-45ea-9daf-4cb66b746363 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:01.010529 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 44/96] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:00 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:01.013047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3344db11-f6ff-45ea-9daf-4cb66b746363 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:01.013663 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3344db11-f6ff-45ea-9daf-4cb66b746363 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:01.019315 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3344db11-f6ff-45ea-9daf-4cb66b746363 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:01.023169 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3344db11-f6ff-45ea-9daf-4cb66b746363 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:01.023844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3344db11-f6ff-45ea-9daf-4cb66b746363 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:01.202117 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-3344db11-f6ff-45ea-9daf-4cb66b746363 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:01.212102 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-3344db11-f6ff-45ea-9daf-4cb66b746363 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1314 microversion: 2.1 time: 0.224224 Nov 02 07:30:01.213584 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 53/97] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:00 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:02.013296 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7b186e96-dd63-4ce0-8c31-0843f1a62fab tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:02.013905 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-7b186e96-dd63-4ce0-8c31-0843f1a62fab tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:02.024457 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-3dc3f1bb-c316-4527-83c6-d7983c59706e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:02.024999 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b186e96-dd63-4ce0-8c31-0843f1a62fab tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:02.024999 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b186e96-dd63-4ce0-8c31-0843f1a62fab tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:02.026254 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-3dc3f1bb-c316-4527-83c6-d7983c59706e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:02.031452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b186e96-dd63-4ce0-8c31-0843f1a62fab tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:02.033055 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b186e96-dd63-4ce0-8c31-0843f1a62fab tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:02.034912 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b186e96-dd63-4ce0-8c31-0843f1a62fab tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:02.035022 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3dc3f1bb-c316-4527-83c6-d7983c59706e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:02.037343 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3dc3f1bb-c316-4527-83c6-d7983c59706e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:02.037734 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b186e96-dd63-4ce0-8c31-0843f1a62fab tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:02.039309 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3dc3f1bb-c316-4527-83c6-d7983c59706e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:02.047341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3dc3f1bb-c316-4527-83c6-d7983c59706e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:02.047341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3dc3f1bb-c316-4527-83c6-d7983c59706e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:02.047341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3dc3f1bb-c316-4527-83c6-d7983c59706e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:02.414682 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-3dc3f1bb-c316-4527-83c6-d7983c59706e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:02.426135 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-3dc3f1bb-c316-4527-83c6-d7983c59706e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1322 microversion: 2.1 time: 0.405752 Nov 02 07:30:02.426787 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 54/98] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:02 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1322 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:30:02.434459 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-7683a584-c594-43f8-942f-cbd4c1189c93 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:02.436339 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-7683a584-c594-43f8-942f-cbd4c1189c93 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:02.451837 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7683a584-c594-43f8-942f-cbd4c1189c93 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:02.454756 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7683a584-c594-43f8-942f-cbd4c1189c93 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:02.456290 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7683a584-c594-43f8-942f-cbd4c1189c93 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:02.459094 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7683a584-c594-43f8-942f-cbd4c1189c93 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:02.462398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7683a584-c594-43f8-942f-cbd4c1189c93 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:02.463095 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7683a584-c594-43f8-942f-cbd4c1189c93 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:02.485435 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-7b186e96-dd63-4ce0-8c31-0843f1a62fab tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:02.498165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-7b186e96-dd63-4ce0-8c31-0843f1a62fab tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:02.500396 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-7b186e96-dd63-4ce0-8c31-0843f1a62fab tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:02.501952 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-7b186e96-dd63-4ce0-8c31-0843f1a62fab tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1407 microversion: 2.20 time: 0.492587 Nov 02 07:30:02.503179 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 45/99] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:30:02 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:30:02.648778 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-253a1c68-a6d8-47f4-af5b-586c3f8c5f3d req-ac0552a0-0de2-491b-9a5c-44bc11ad16a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684b9aec-ddff-4c9c-9c18-957a432b3c17", "name": "network-vif-plugged", "status": "completed", "tag": "3c1f0233-b78d-4abc-80ac-644aeafb4656"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:30:02.668513 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-253a1c68-a6d8-47f4-af5b-586c3f8c5f3d req-ac0552a0-0de2-491b-9a5c-44bc11ad16a4 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:02.669136 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-253a1c68-a6d8-47f4-af5b-586c3f8c5f3d req-ac0552a0-0de2-491b-9a5c-44bc11ad16a4 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:02.670100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-253a1c68-a6d8-47f4-af5b-586c3f8c5f3d req-ac0552a0-0de2-491b-9a5c-44bc11ad16a4 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:02.696753 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-253a1c68-a6d8-47f4-af5b-586c3f8c5f3d req-ac0552a0-0de2-491b-9a5c-44bc11ad16a4 service nova] Creating event network-vif-plugged:3c1f0233-b78d-4abc-80ac-644aeafb4656 for instance 684b9aec-ddff-4c9c-9c18-957a432b3c17 on hv-cinder-80473 Nov 02 07:30:02.711708 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-253a1c68-a6d8-47f4-af5b-586c3f8c5f3d req-ac0552a0-0de2-491b-9a5c-44bc11ad16a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068269 Nov 02 07:30:02.717502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 46/100] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:30:02.753553 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7683a584-c594-43f8-942f-cbd4c1189c93 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:02.762494 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-7683a584-c594-43f8-942f-cbd4c1189c93 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1314 microversion: 2.1 time: 0.334608 Nov 02 07:30:02.775097 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 55/101] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:02 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:03.454140 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ada60821-85ae-4aa8-bce7-10d01a931c78 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:03.454871 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ada60821-85ae-4aa8-bce7-10d01a931c78 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:03.464464 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ada60821-85ae-4aa8-bce7-10d01a931c78 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:03.465725 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ada60821-85ae-4aa8-bce7-10d01a931c78 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:03.466707 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ada60821-85ae-4aa8-bce7-10d01a931c78 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:03.468937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ada60821-85ae-4aa8-bce7-10d01a931c78 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:03.473197 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ada60821-85ae-4aa8-bce7-10d01a931c78 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:03.474411 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ada60821-85ae-4aa8-bce7-10d01a931c78 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:03.535345 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f422c17d-ce30-48bc-992d-4c4f74408087 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:03.536766 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f422c17d-ce30-48bc-992d-4c4f74408087 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:03.556927 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f422c17d-ce30-48bc-992d-4c4f74408087 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:03.557531 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f422c17d-ce30-48bc-992d-4c4f74408087 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:03.563133 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f422c17d-ce30-48bc-992d-4c4f74408087 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:03.563133 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f422c17d-ce30-48bc-992d-4c4f74408087 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:03.563133 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f422c17d-ce30-48bc-992d-4c4f74408087 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:03.563133 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f422c17d-ce30-48bc-992d-4c4f74408087 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:03.961773 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ada60821-85ae-4aa8-bce7-10d01a931c78 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:03.974415 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ada60821-85ae-4aa8-bce7-10d01a931c78 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1322 microversion: 2.1 time: 0.522227 Nov 02 07:30:03.976810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 47/102] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:03 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1322 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:03.986577 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e5f29373-e4a0-47a1-b770-be941b5402bb tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:03.987184 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e5f29373-e4a0-47a1-b770-be941b5402bb tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:04.001294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f422c17d-ce30-48bc-992d-4c4f74408087 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:04.011983 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f422c17d-ce30-48bc-992d-4c4f74408087 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:04.013375 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f422c17d-ce30-48bc-992d-4c4f74408087 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:04.014639 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f422c17d-ce30-48bc-992d-4c4f74408087 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1407 microversion: 2.20 time: 0.488995 Nov 02 07:30:04.015373 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 56/103] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:30:03 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:30:04.029652 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e5f29373-e4a0-47a1-b770-be941b5402bb tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:04.030772 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e5f29373-e4a0-47a1-b770-be941b5402bb tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:04.034513 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e5f29373-e4a0-47a1-b770-be941b5402bb tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:04.036859 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e5f29373-e4a0-47a1-b770-be941b5402bb tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:04.037897 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e5f29373-e4a0-47a1-b770-be941b5402bb tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:04.038682 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e5f29373-e4a0-47a1-b770-be941b5402bb tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:04.203398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-e5f29373-e4a0-47a1-b770-be941b5402bb tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:04.212420 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e5f29373-e4a0-47a1-b770-be941b5402bb tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1501 microversion: 2.1 time: 0.234421 Nov 02 07:30:04.213137 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 48/104] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:03 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1501 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:04.885689 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-32665103-e63f-4572-b0e0-44ac05981e79 req-37efd853-545f-45cc-8b74-33761f00bcb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae04f42-6d0d-42e5-ae5f-8022b6f546df", "name": "network-vif-plugged", "status": "completed", "tag": "ba58ff3d-570b-447a-86ec-a6d9a70152fc"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:30:04.903225 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-32665103-e63f-4572-b0e0-44ac05981e79 req-37efd853-545f-45cc-8b74-33761f00bcb1 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:04.904020 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-32665103-e63f-4572-b0e0-44ac05981e79 req-37efd853-545f-45cc-8b74-33761f00bcb1 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:04.904726 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-32665103-e63f-4572-b0e0-44ac05981e79 req-37efd853-545f-45cc-8b74-33761f00bcb1 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:04.918091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-32665103-e63f-4572-b0e0-44ac05981e79 req-37efd853-545f-45cc-8b74-33761f00bcb1 service nova] Creating event network-vif-plugged:ba58ff3d-570b-447a-86ec-a6d9a70152fc for instance cae04f42-6d0d-42e5-ae5f-8022b6f546df on hv-cinder-80473 Nov 02 07:30:04.923901 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-32665103-e63f-4572-b0e0-44ac05981e79 req-37efd853-545f-45cc-8b74-33761f00bcb1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050073 Nov 02 07:30:04.924747 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 57/105] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:30:05.004288 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-81e7eccc-a7b4-4864-b730-f051c11d03eb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:05.005109 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-81e7eccc-a7b4-4864-b730-f051c11d03eb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:05.018089 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81e7eccc-a7b4-4864-b730-f051c11d03eb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:05.018781 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81e7eccc-a7b4-4864-b730-f051c11d03eb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:05.019461 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81e7eccc-a7b4-4864-b730-f051c11d03eb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:05.020976 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81e7eccc-a7b4-4864-b730-f051c11d03eb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:05.022007 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81e7eccc-a7b4-4864-b730-f051c11d03eb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:05.022709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81e7eccc-a7b4-4864-b730-f051c11d03eb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:05.044333 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b816576e-606a-467b-afb6-6a3c619f19e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:05.045069 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b816576e-606a-467b-afb6-6a3c619f19e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:05.061628 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b816576e-606a-467b-afb6-6a3c619f19e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:05.063550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b816576e-606a-467b-afb6-6a3c619f19e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:05.064416 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b816576e-606a-467b-afb6-6a3c619f19e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:05.066544 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b816576e-606a-467b-afb6-6a3c619f19e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:05.067011 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b816576e-606a-467b-afb6-6a3c619f19e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:05.068542 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b816576e-606a-467b-afb6-6a3c619f19e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:05.524781 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b816576e-606a-467b-afb6-6a3c619f19e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:05.537503 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b816576e-606a-467b-afb6-6a3c619f19e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:05.544149 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b816576e-606a-467b-afb6-6a3c619f19e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:05.545063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-81e7eccc-a7b4-4864-b730-f051c11d03eb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:05.550210 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b816576e-606a-467b-afb6-6a3c619f19e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1407 microversion: 2.20 time: 0.509512 Nov 02 07:30:05.550913 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 58/106] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:30:05 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1407 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:30:05.556369 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-81e7eccc-a7b4-4864-b730-f051c11d03eb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1516 microversion: 2.1 time: 0.557617 Nov 02 07:30:05.557122 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 49/107] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:04 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1516 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:05.581738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-bf27a495-599b-44f2-b473-e02cde989ff3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:30:05.583997 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-bf27a495-599b-44f2-b473-e02cde989ff3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:05.590842 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bf27a495-599b-44f2-b473-e02cde989ff3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:05.591331 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bf27a495-599b-44f2-b473-e02cde989ff3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:05.591911 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bf27a495-599b-44f2-b473-e02cde989ff3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:05.592619 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bf27a495-599b-44f2-b473-e02cde989ff3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:05.593061 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bf27a495-599b-44f2-b473-e02cde989ff3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:05.593483 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bf27a495-599b-44f2-b473-e02cde989ff3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:05.670638 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.objects.instance [None req-bf27a495-599b-44f2-b473-e02cde989ff3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lazy-loading 'flavor' on Instance uuid 684b9aec-ddff-4c9c-9c18-957a432b3c17 {{(pid=118991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:30:05.701317 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=100 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:05.781745 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d0fc9246-65a7-4462-b374-b572baaafe3a tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe7e1010-3c95-4442-82b0-41ae55264c89"}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:30:05.785118 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-d0fc9246-65a7-4462-b374-b572baaafe3a tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:05.802277 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d0fc9246-65a7-4462-b374-b572baaafe3a tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:05.804471 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d0fc9246-65a7-4462-b374-b572baaafe3a tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:05.804927 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d0fc9246-65a7-4462-b374-b572baaafe3a tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:05.805637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d0fc9246-65a7-4462-b374-b572baaafe3a tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:05.809410 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d0fc9246-65a7-4462-b374-b572baaafe3a tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:05.810075 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d0fc9246-65a7-4462-b374-b572baaafe3a tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:05.826411 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-bf27a495-599b-44f2-b473-e02cde989ff3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "POST /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17/action" status: 200 len: 32 microversion: 2.1 time: 0.246953 Nov 02 07:30:05.827083 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 59/108] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 07:30:05 2022] POST /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17/action => generated 32 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 07:30:05.844824 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-cf254672-dffa-4c40-9396-81c0a03d938b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:05.845533 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-cf254672-dffa-4c40-9396-81c0a03d938b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:05.857329 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cf254672-dffa-4c40-9396-81c0a03d938b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:05.858844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cf254672-dffa-4c40-9396-81c0a03d938b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:05.859615 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cf254672-dffa-4c40-9396-81c0a03d938b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:05.862287 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cf254672-dffa-4c40-9396-81c0a03d938b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:05.863223 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cf254672-dffa-4c40-9396-81c0a03d938b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:05.863950 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cf254672-dffa-4c40-9396-81c0a03d938b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:06.056497 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-cf254672-dffa-4c40-9396-81c0a03d938b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:06.082634 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-cf254672-dffa-4c40-9396-81c0a03d938b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.244703 Nov 02 07:30:06.082634 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 60/109] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:05 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:06.579457 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b52cb850-7b1b-49da-97da-c940d4db2bb0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:06.580071 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b52cb850-7b1b-49da-97da-c940d4db2bb0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:06.594699 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b52cb850-7b1b-49da-97da-c940d4db2bb0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:06.595442 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b52cb850-7b1b-49da-97da-c940d4db2bb0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:06.595895 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b52cb850-7b1b-49da-97da-c940d4db2bb0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:06.596820 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b52cb850-7b1b-49da-97da-c940d4db2bb0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:06.597480 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b52cb850-7b1b-49da-97da-c940d4db2bb0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:06.597897 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b52cb850-7b1b-49da-97da-c940d4db2bb0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:06.758028 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-d0fc9246-65a7-4462-b374-b572baaafe3a tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "POST /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.982301 Nov 02 07:30:06.765014 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 50/110] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 07:30:05 2022] POST /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef/os-volume_attachments => generated 194 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:30:06.846926 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b52cb850-7b1b-49da-97da-c940d4db2bb0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:06.846926 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b52cb850-7b1b-49da-97da-c940d4db2bb0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:06.851758 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b52cb850-7b1b-49da-97da-c940d4db2bb0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:06.852158 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b52cb850-7b1b-49da-97da-c940d4db2bb0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1407 microversion: 2.20 time: 0.276748 Nov 02 07:30:06.852779 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 61/111] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:30:06 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:30:07.104109 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e9b7ab6e-3490-4e31-99f0-cd1504713d19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:07.104869 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e9b7ab6e-3490-4e31-99f0-cd1504713d19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:07.114236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e9b7ab6e-3490-4e31-99f0-cd1504713d19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:07.114769 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e9b7ab6e-3490-4e31-99f0-cd1504713d19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:07.115236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e9b7ab6e-3490-4e31-99f0-cd1504713d19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:07.116191 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e9b7ab6e-3490-4e31-99f0-cd1504713d19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:07.116653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e9b7ab6e-3490-4e31-99f0-cd1504713d19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:07.117077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e9b7ab6e-3490-4e31-99f0-cd1504713d19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:07.443118 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-e9b7ab6e-3490-4e31-99f0-cd1504713d19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:07.451460 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e9b7ab6e-3490-4e31-99f0-cd1504713d19 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.352382 Nov 02 07:30:07.452047 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 51/112] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:07 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:07.878238 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-7cfff8e1-27da-4814-8678-25efc02912a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:07.878931 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-7cfff8e1-27da-4814-8678-25efc02912a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:07.885567 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7cfff8e1-27da-4814-8678-25efc02912a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:07.887817 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7cfff8e1-27da-4814-8678-25efc02912a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:07.889538 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7cfff8e1-27da-4814-8678-25efc02912a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:07.890269 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7cfff8e1-27da-4814-8678-25efc02912a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:07.890759 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7cfff8e1-27da-4814-8678-25efc02912a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:07.891177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7cfff8e1-27da-4814-8678-25efc02912a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:08.086944 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7cfff8e1-27da-4814-8678-25efc02912a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:08.103817 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7cfff8e1-27da-4814-8678-25efc02912a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:08.106792 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7cfff8e1-27da-4814-8678-25efc02912a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:08.108527 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-7cfff8e1-27da-4814-8678-25efc02912a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1597 microversion: 2.20 time: 0.234528 Nov 02 07:30:08.123221 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 62/113] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:30:07 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1597 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:30:08.143427 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f2f7dc5c-af5e-4901-b9dd-26aa04d6556e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:08.144562 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f2f7dc5c-af5e-4901-b9dd-26aa04d6556e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:08.151801 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f2f7dc5c-af5e-4901-b9dd-26aa04d6556e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:08.153331 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f2f7dc5c-af5e-4901-b9dd-26aa04d6556e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:08.153903 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f2f7dc5c-af5e-4901-b9dd-26aa04d6556e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:08.154988 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f2f7dc5c-af5e-4901-b9dd-26aa04d6556e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:08.155704 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f2f7dc5c-af5e-4901-b9dd-26aa04d6556e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:08.156296 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f2f7dc5c-af5e-4901-b9dd-26aa04d6556e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:08.268434 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f2f7dc5c-af5e-4901-b9dd-26aa04d6556e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.130104 Nov 02 07:30:08.269337 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 52/114] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Nov 2 07:30:08 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 07:30:08.477975 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-48bba100-133b-49ec-ba26-a8e0e7058f5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:08.478721 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-48bba100-133b-49ec-ba26-a8e0e7058f5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:08.491672 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-48bba100-133b-49ec-ba26-a8e0e7058f5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:08.493033 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-48bba100-133b-49ec-ba26-a8e0e7058f5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:08.495910 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-48bba100-133b-49ec-ba26-a8e0e7058f5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:08.496950 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-48bba100-133b-49ec-ba26-a8e0e7058f5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:08.499173 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-48bba100-133b-49ec-ba26-a8e0e7058f5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:08.500324 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-48bba100-133b-49ec-ba26-a8e0e7058f5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:08.872951 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-48bba100-133b-49ec-ba26-a8e0e7058f5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:08.890536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-48bba100-133b-49ec-ba26-a8e0e7058f5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.415243 Nov 02 07:30:08.900318 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 63/115] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:08 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:09.919819 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-5dcb25d1-c79e-4fca-b40c-d4cd2059cee8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:09.920508 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-5dcb25d1-c79e-4fca-b40c-d4cd2059cee8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:09.927897 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5dcb25d1-c79e-4fca-b40c-d4cd2059cee8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:09.928489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5dcb25d1-c79e-4fca-b40c-d4cd2059cee8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:09.929122 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5dcb25d1-c79e-4fca-b40c-d4cd2059cee8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:09.929812 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5dcb25d1-c79e-4fca-b40c-d4cd2059cee8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:09.930257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5dcb25d1-c79e-4fca-b40c-d4cd2059cee8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:09.930858 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5dcb25d1-c79e-4fca-b40c-d4cd2059cee8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:10.101535 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-8dccc21b-dc45-4e52-a3d2-1c7091efadf4 req-b6e0f87c-2bab-4fe7-926d-17236e8fd1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae04f42-6d0d-42e5-ae5f-8022b6f546df", "tag": "ba58ff3d-570b-447a-86ec-a6d9a70152fc"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:30:10.114865 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-8dccc21b-dc45-4e52-a3d2-1c7091efadf4 req-b6e0f87c-2bab-4fe7-926d-17236e8fd1f3 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:10.115714 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-8dccc21b-dc45-4e52-a3d2-1c7091efadf4 req-b6e0f87c-2bab-4fe7-926d-17236e8fd1f3 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:10.116334 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-8dccc21b-dc45-4e52-a3d2-1c7091efadf4 req-b6e0f87c-2bab-4fe7-926d-17236e8fd1f3 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:10.123481 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-5dcb25d1-c79e-4fca-b40c-d4cd2059cee8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:10.134921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-5dcb25d1-c79e-4fca-b40c-d4cd2059cee8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.220180 Nov 02 07:30:10.135910 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 53/116] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:09 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:10.146696 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-8dccc21b-dc45-4e52-a3d2-1c7091efadf4 req-b6e0f87c-2bab-4fe7-926d-17236e8fd1f3 service nova] Creating event network-changed:ba58ff3d-570b-447a-86ec-a6d9a70152fc for instance cae04f42-6d0d-42e5-ae5f-8022b6f546df on hv-cinder-80473 Nov 02 07:30:10.152689 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-8dccc21b-dc45-4e52-a3d2-1c7091efadf4 req-b6e0f87c-2bab-4fe7-926d-17236e8fd1f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051539 Nov 02 07:30:10.152689 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 64/117] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:30:11.164588 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a743688e-cf20-46c0-826c-4f1903d6c093 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:11.165932 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a743688e-cf20-46c0-826c-4f1903d6c093 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:11.173831 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a743688e-cf20-46c0-826c-4f1903d6c093 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:11.174665 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a743688e-cf20-46c0-826c-4f1903d6c093 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:11.175365 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a743688e-cf20-46c0-826c-4f1903d6c093 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:11.178081 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a743688e-cf20-46c0-826c-4f1903d6c093 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:11.178719 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a743688e-cf20-46c0-826c-4f1903d6c093 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:11.179362 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a743688e-cf20-46c0-826c-4f1903d6c093 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:11.184989 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:11.361477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a743688e-cf20-46c0-826c-4f1903d6c093 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:11.384097 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a743688e-cf20-46c0-826c-4f1903d6c093 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.225836 Nov 02 07:30:11.385791 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 54/118] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:11 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:12.418557 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-96232e4e-7d46-4d27-bbd7-523069adbda1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:12.418557 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-96232e4e-7d46-4d27-bbd7-523069adbda1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:12.420042 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-96232e4e-7d46-4d27-bbd7-523069adbda1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:12.420872 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-96232e4e-7d46-4d27-bbd7-523069adbda1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:12.421521 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-96232e4e-7d46-4d27-bbd7-523069adbda1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:12.422437 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-96232e4e-7d46-4d27-bbd7-523069adbda1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:12.423081 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-96232e4e-7d46-4d27-bbd7-523069adbda1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:12.423802 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-96232e4e-7d46-4d27-bbd7-523069adbda1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:12.577018 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-96232e4e-7d46-4d27-bbd7-523069adbda1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:12.585387 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-96232e4e-7d46-4d27-bbd7-523069adbda1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.178134 Nov 02 07:30:12.585948 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 65/119] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:12 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:13.609686 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9a228c31-318e-4887-b4b7-bd7584d860df tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:13.610970 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9a228c31-318e-4887-b4b7-bd7584d860df tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:13.618786 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9a228c31-318e-4887-b4b7-bd7584d860df tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:13.619530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9a228c31-318e-4887-b4b7-bd7584d860df tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:13.620225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9a228c31-318e-4887-b4b7-bd7584d860df tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:13.621028 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9a228c31-318e-4887-b4b7-bd7584d860df tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:13.621489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9a228c31-318e-4887-b4b7-bd7584d860df tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:13.622044 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9a228c31-318e-4887-b4b7-bd7584d860df tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:13.752234 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9a228c31-318e-4887-b4b7-bd7584d860df tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:13.759866 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9a228c31-318e-4887-b4b7-bd7584d860df tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.155043 Nov 02 07:30:13.760429 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 55/120] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:13 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:14.782960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f4e31cc7-26d5-4c01-a11e-9cf338630a0e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:14.783558 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f4e31cc7-26d5-4c01-a11e-9cf338630a0e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:14.789565 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f4e31cc7-26d5-4c01-a11e-9cf338630a0e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:14.790038 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f4e31cc7-26d5-4c01-a11e-9cf338630a0e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:14.790493 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f4e31cc7-26d5-4c01-a11e-9cf338630a0e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:14.791169 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f4e31cc7-26d5-4c01-a11e-9cf338630a0e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:14.791615 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f4e31cc7-26d5-4c01-a11e-9cf338630a0e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:14.792031 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f4e31cc7-26d5-4c01-a11e-9cf338630a0e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:14.932221 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f4e31cc7-26d5-4c01-a11e-9cf338630a0e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:14.941397 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f4e31cc7-26d5-4c01-a11e-9cf338630a0e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.162240 Nov 02 07:30:14.952910 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 66/121] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:14 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:15.977965 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ad2c96fb-70b4-4c2e-bb41-42697af7e23a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:15.978705 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ad2c96fb-70b4-4c2e-bb41-42697af7e23a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:15.988741 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ad2c96fb-70b4-4c2e-bb41-42697af7e23a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:15.989426 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ad2c96fb-70b4-4c2e-bb41-42697af7e23a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:15.989858 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ad2c96fb-70b4-4c2e-bb41-42697af7e23a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:15.990758 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ad2c96fb-70b4-4c2e-bb41-42697af7e23a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:15.991217 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ad2c96fb-70b4-4c2e-bb41-42697af7e23a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:15.991747 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ad2c96fb-70b4-4c2e-bb41-42697af7e23a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:16.133732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ad2c96fb-70b4-4c2e-bb41-42697af7e23a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:16.142763 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ad2c96fb-70b4-4c2e-bb41-42697af7e23a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.171545 Nov 02 07:30:16.143323 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 56/122] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:15 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:17.167753 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-827c305b-4b95-4c05-ab09-e1ebf6ef1a81 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:17.169371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-827c305b-4b95-4c05-ab09-e1ebf6ef1a81 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:17.178112 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-827c305b-4b95-4c05-ab09-e1ebf6ef1a81 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:17.178622 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-827c305b-4b95-4c05-ab09-e1ebf6ef1a81 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:17.179169 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-827c305b-4b95-4c05-ab09-e1ebf6ef1a81 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:17.179989 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-827c305b-4b95-4c05-ab09-e1ebf6ef1a81 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:17.180479 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-827c305b-4b95-4c05-ab09-e1ebf6ef1a81 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:17.181074 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-827c305b-4b95-4c05-ab09-e1ebf6ef1a81 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:17.332128 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-827c305b-4b95-4c05-ab09-e1ebf6ef1a81 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:17.340900 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-827c305b-4b95-4c05-ab09-e1ebf6ef1a81 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.178224 Nov 02 07:30:17.342059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 67/123] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:17 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:18.370533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d7d734a1-025d-4490-a36e-4dab87801219 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:18.370533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-d7d734a1-025d-4490-a36e-4dab87801219 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:18.378891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d7d734a1-025d-4490-a36e-4dab87801219 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:18.379658 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d7d734a1-025d-4490-a36e-4dab87801219 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:18.380303 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d7d734a1-025d-4490-a36e-4dab87801219 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:18.381174 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d7d734a1-025d-4490-a36e-4dab87801219 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:18.381878 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d7d734a1-025d-4490-a36e-4dab87801219 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:18.382315 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d7d734a1-025d-4490-a36e-4dab87801219 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:18.609285 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-d7d734a1-025d-4490-a36e-4dab87801219 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:18.620261 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-d7d734a1-025d-4490-a36e-4dab87801219 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.258261 Nov 02 07:30:18.641520 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 57/124] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:18 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:19.327764 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-72473bcf-adce-43fd-ae98-a5bfadfdd75f tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:19.331968 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-72473bcf-adce-43fd-ae98-a5bfadfdd75f tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:19.340614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-72473bcf-adce-43fd-ae98-a5bfadfdd75f tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:19.341229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-72473bcf-adce-43fd-ae98-a5bfadfdd75f tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:19.341807 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-72473bcf-adce-43fd-ae98-a5bfadfdd75f tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:19.343798 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-72473bcf-adce-43fd-ae98-a5bfadfdd75f tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:19.344991 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-72473bcf-adce-43fd-ae98-a5bfadfdd75f tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:19.346260 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-72473bcf-adce-43fd-ae98-a5bfadfdd75f tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:19.379676 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-72473bcf-adce-43fd-ae98-a5bfadfdd75f tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Going to try to terminate instance {{(pid=118991) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:30:19.488868 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-72473bcf-adce-43fd-ae98-a5bfadfdd75f tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 204 len: 0 microversion: 2.1 time: 0.164004 Nov 02 07:30:19.489680 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 68/125] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:30:19 2022] DELETE /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:30:19.501068 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-4eccc3a6-1395-4c00-8e5d-503b4ffcf9b6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:19.501704 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-4eccc3a6-1395-4c00-8e5d-503b4ffcf9b6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:19.509061 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4eccc3a6-1395-4c00-8e5d-503b4ffcf9b6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:19.509815 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4eccc3a6-1395-4c00-8e5d-503b4ffcf9b6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:19.510606 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4eccc3a6-1395-4c00-8e5d-503b4ffcf9b6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:19.512230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4eccc3a6-1395-4c00-8e5d-503b4ffcf9b6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:19.513125 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4eccc3a6-1395-4c00-8e5d-503b4ffcf9b6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:19.513762 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4eccc3a6-1395-4c00-8e5d-503b4ffcf9b6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:19.657264 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-4fcabc9f-d98e-4da6-bb56-04a02cd507ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:19.657964 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-4fcabc9f-d98e-4da6-bb56-04a02cd507ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:19.664937 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4fcabc9f-d98e-4da6-bb56-04a02cd507ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:19.665415 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4fcabc9f-d98e-4da6-bb56-04a02cd507ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:19.665850 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4fcabc9f-d98e-4da6-bb56-04a02cd507ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:19.666580 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4fcabc9f-d98e-4da6-bb56-04a02cd507ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:19.667021 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4fcabc9f-d98e-4da6-bb56-04a02cd507ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:19.667678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4fcabc9f-d98e-4da6-bb56-04a02cd507ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:19.704869 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-4eccc3a6-1395-4c00-8e5d-503b4ffcf9b6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:19.716260 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-4eccc3a6-1395-4c00-8e5d-503b4ffcf9b6 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1553 microversion: 2.1 time: 0.221832 Nov 02 07:30:19.717514 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 58/126] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:19 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1553 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:19.822916 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-4fcabc9f-d98e-4da6-bb56-04a02cd507ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:19.832232 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-4fcabc9f-d98e-4da6-bb56-04a02cd507ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.179981 Nov 02 07:30:19.832944 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 69/127] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:19 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:20.743101 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9cf6fc02-9489-4fcf-867f-e49c4cf415e3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:20.744169 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9cf6fc02-9489-4fcf-867f-e49c4cf415e3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:20.758395 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9cf6fc02-9489-4fcf-867f-e49c4cf415e3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:20.759380 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9cf6fc02-9489-4fcf-867f-e49c4cf415e3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:20.760801 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9cf6fc02-9489-4fcf-867f-e49c4cf415e3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:20.762591 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9cf6fc02-9489-4fcf-867f-e49c4cf415e3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:20.763871 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9cf6fc02-9489-4fcf-867f-e49c4cf415e3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:20.765256 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9cf6fc02-9489-4fcf-867f-e49c4cf415e3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:20.856762 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-986e9f32-0c28-4bfb-b79f-ba989fb29b35 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:20.858545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-986e9f32-0c28-4bfb-b79f-ba989fb29b35 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:20.864862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-986e9f32-0c28-4bfb-b79f-ba989fb29b35 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:20.865665 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-986e9f32-0c28-4bfb-b79f-ba989fb29b35 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:20.866312 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-986e9f32-0c28-4bfb-b79f-ba989fb29b35 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:20.867113 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-986e9f32-0c28-4bfb-b79f-ba989fb29b35 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:20.867924 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-986e9f32-0c28-4bfb-b79f-ba989fb29b35 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:20.868464 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-986e9f32-0c28-4bfb-b79f-ba989fb29b35 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:21.168791 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9cf6fc02-9489-4fcf-867f-e49c4cf415e3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:21.180599 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9cf6fc02-9489-4fcf-867f-e49c4cf415e3 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1553 microversion: 2.1 time: 0.442861 Nov 02 07:30:21.187394 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 59/128] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:20 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1553 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:21.193372 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-986e9f32-0c28-4bfb-b79f-ba989fb29b35 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:21.206062 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-986e9f32-0c28-4bfb-b79f-ba989fb29b35 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.351470 Nov 02 07:30:21.206062 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 70/129] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:20 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:22.226852 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c632ed5c-bef7-40ad-aa57-36b5a62cbf14 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:22.241667 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c632ed5c-bef7-40ad-aa57-36b5a62cbf14 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:22.241778 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-288c53c3-1cd2-4bf0-b04c-3c46ad604638 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:22.241778 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-288c53c3-1cd2-4bf0-b04c-3c46ad604638 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:22.241778 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-288c53c3-1cd2-4bf0-b04c-3c46ad604638 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:22.242333 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c632ed5c-bef7-40ad-aa57-36b5a62cbf14 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:22.242450 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-288c53c3-1cd2-4bf0-b04c-3c46ad604638 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:22.248879 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c632ed5c-bef7-40ad-aa57-36b5a62cbf14 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:22.249608 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c632ed5c-bef7-40ad-aa57-36b5a62cbf14 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:22.252644 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-288c53c3-1cd2-4bf0-b04c-3c46ad604638 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:22.253398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-288c53c3-1cd2-4bf0-b04c-3c46ad604638 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:22.253874 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-288c53c3-1cd2-4bf0-b04c-3c46ad604638 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:22.254297 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-288c53c3-1cd2-4bf0-b04c-3c46ad604638 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:22.259168 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c632ed5c-bef7-40ad-aa57-36b5a62cbf14 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:22.259665 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c632ed5c-bef7-40ad-aa57-36b5a62cbf14 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:22.262966 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c632ed5c-bef7-40ad-aa57-36b5a62cbf14 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:23.374911 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c632ed5c-bef7-40ad-aa57-36b5a62cbf14 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:23.438039 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-288c53c3-1cd2-4bf0-b04c-3c46ad604638 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:23.439685 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c632ed5c-bef7-40ad-aa57-36b5a62cbf14 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1553 microversion: 2.1 time: 1.227702 Nov 02 07:30:23.441253 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 60/130] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:22 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1553 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:23.490933 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-8a6868ab-f315-417b-94f6-23d013b54bae req-4a0d623e-c671-46d2-9274-e203b7edaf80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5d6941-4c0e-4d53-94a7-70dcc586fbef", "name": "network-vif-deleted", "tag": "1506af6f-e368-448b-aa78-a2c86ce9b462"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:30:23.561034 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-288c53c3-1cd2-4bf0-b04c-3c46ad604638 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 1.331174 Nov 02 07:30:23.600916 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 71/131] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:22 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:30:23.653462 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-8a6868ab-f315-417b-94f6-23d013b54bae req-4a0d623e-c671-46d2-9274-e203b7edaf80 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:23.655481 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-8a6868ab-f315-417b-94f6-23d013b54bae req-4a0d623e-c671-46d2-9274-e203b7edaf80 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:23.662303 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-8a6868ab-f315-417b-94f6-23d013b54bae req-4a0d623e-c671-46d2-9274-e203b7edaf80 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:23.711430 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-8a6868ab-f315-417b-94f6-23d013b54bae req-4a0d623e-c671-46d2-9274-e203b7edaf80 service nova] Creating event network-vif-deleted:1506af6f-e368-448b-aa78-a2c86ce9b462 for instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef on hv-cinder-80473 Nov 02 07:30:23.747246 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-8a6868ab-f315-417b-94f6-23d013b54bae req-4a0d623e-c671-46d2-9274-e203b7edaf80 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280465 Nov 02 07:30:23.751399 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 61/132] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:30:24.465973 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0e55d779-69da-4822-b0ee-29499cc0aa21 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:24.468083 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-0e55d779-69da-4822-b0ee-29499cc0aa21 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:24.481515 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:24.490479 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0e55d779-69da-4822-b0ee-29499cc0aa21 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:24.495600 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0e55d779-69da-4822-b0ee-29499cc0aa21 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:24.502145 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0e55d779-69da-4822-b0ee-29499cc0aa21 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:24.505980 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0e55d779-69da-4822-b0ee-29499cc0aa21 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:24.515410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0e55d779-69da-4822-b0ee-29499cc0aa21 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:24.518328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0e55d779-69da-4822-b0ee-29499cc0aa21 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:24.626406 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ac341bc7-06de-434d-b362-3276a9aa23ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:24.627773 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ac341bc7-06de-434d-b362-3276a9aa23ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:24.643070 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ac341bc7-06de-434d-b362-3276a9aa23ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:24.644007 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ac341bc7-06de-434d-b362-3276a9aa23ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:24.645246 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ac341bc7-06de-434d-b362-3276a9aa23ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:24.651462 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ac341bc7-06de-434d-b362-3276a9aa23ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:24.652738 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ac341bc7-06de-434d-b362-3276a9aa23ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:24.653387 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ac341bc7-06de-434d-b362-3276a9aa23ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:24.705481 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0e55d779-69da-4822-b0ee-29499cc0aa21 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:24.705973 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0e55d779-69da-4822-b0ee-29499cc0aa21 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:24.706419 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0e55d779-69da-4822-b0ee-29499cc0aa21 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:24.706867 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.objects.instance [None req-0e55d779-69da-4822-b0ee-29499cc0aa21 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lazy-loading 'fault' on Instance uuid 7b5d6941-4c0e-4d53-94a7-70dcc586fbef {{(pid=118991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:30:24.984974 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0e55d779-69da-4822-b0ee-29499cc0aa21 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a6f8d01e6d433ca467238f07ec15ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f676ec82a80f4425a6fa7562ee47a4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:24.988660 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ac341bc7-06de-434d-b362-3276a9aa23ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:25.003734 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0e55d779-69da-4822-b0ee-29499cc0aa21 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 200 len: 1350 microversion: 2.1 time: 0.541429 Nov 02 07:30:25.005323 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ac341bc7-06de-434d-b362-3276a9aa23ac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.384015 Nov 02 07:30:25.006590 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 62/133] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:24 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:25.021032 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 72/134] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:24 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 1350 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:26.028192 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-72e2a329-bb9e-483f-a9e8-54bf70808aa1 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:26.028836 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-72e2a329-bb9e-483f-a9e8-54bf70808aa1 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:26.035280 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-beb4afcd-3460-49a1-9b1e-a2f4cc26bec7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:26.035883 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-beb4afcd-3460-49a1-9b1e-a2f4cc26bec7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:26.040732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=52 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:26.046799 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-beb4afcd-3460-49a1-9b1e-a2f4cc26bec7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:26.047291 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-beb4afcd-3460-49a1-9b1e-a2f4cc26bec7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:26.047725 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-beb4afcd-3460-49a1-9b1e-a2f4cc26bec7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:26.048431 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-beb4afcd-3460-49a1-9b1e-a2f4cc26bec7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:26.048879 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-beb4afcd-3460-49a1-9b1e-a2f4cc26bec7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:26.049311 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-beb4afcd-3460-49a1-9b1e-a2f4cc26bec7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:26.054783 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-72e2a329-bb9e-483f-a9e8-54bf70808aa1 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:26.055279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-72e2a329-bb9e-483f-a9e8-54bf70808aa1 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:26.055713 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-72e2a329-bb9e-483f-a9e8-54bf70808aa1 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:26.056413 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-72e2a329-bb9e-483f-a9e8-54bf70808aa1 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:26.056867 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-72e2a329-bb9e-483f-a9e8-54bf70808aa1 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:26.057290 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-72e2a329-bb9e-483f-a9e8-54bf70808aa1 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:26.093612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:26.097326 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-72e2a329-bb9e-483f-a9e8-54bf70808aa1 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] HTTP exception thrown: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-72e2a329-bb9e-483f-a9e8-54bf70808aa1 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Request method failure captured: Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef HTTP/1.1 Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhxYKQxG0r_dI8Hf7PcZ85NXr8TYjIhOnphM8AWlrOY1REaHnLO8Pv2yRP4OQWDdbOCEPeEZc2cNpIbd5-rvjQMDx7OhirJd82ZWoFvFVpfRJsb3kEpx2ZTOVHrhWDvsye9TfrQPSqmjwy42kqAIwNBTfihp3f6HtesUvkpjy8jBjRQ Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: f676ec82a80f4425a6fa7562ee47a4cf Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-DeleteServersTestJSON-1091788271 Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:30:26.118951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:30:26.120664 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f676ec82a80f4425a6fa7562ee47a4cf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f676ec82a80f4425a6fa7562ee47a4cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f676ec82a80f4425a6fa7562ee47a4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f676ec82a80f4425a6fa7562ee47a4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:30:26.120664 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-DeleteServersTestJSON-1091788271 Nov 02 07:30:26.120664 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: f676ec82a80f4425a6fa7562ee47a4cf Nov 02 07:30:26.120664 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-DeleteServersTestJSON-1091788271 Nov 02 07:30:26.120664 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-DeleteServersTestJSON-1091788271-project Nov 02 07:30:26.120664 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:30:26.120664 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:30:26.120664 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 17a6f8d01e6d433ca467238f07ec15ba Nov 02 07:30:26.120664 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-DeleteServersTestJSON-1091788271-project Nov 02 07:30:26.120664 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:30:26.120664 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:26.120664 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '7b5d6941-4c0e-4d53-94a7-70dcc586fbef'} Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:30:26.121477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:26.123233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:30:26.124209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-72e2a329-bb9e-483f-a9e8-54bf70808aa1 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Returning 404 to user: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:30:26.124209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-72e2a329-bb9e-483f-a9e8-54bf70808aa1 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 404 len: 111 microversion: 2.1 time: 0.096474 Nov 02 07:30:26.127514 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 63/135] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:26 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:30:26.290800 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-beb4afcd-3460-49a1-9b1e-a2f4cc26bec7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:26.304982 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-beb4afcd-3460-49a1-9b1e-a2f4cc26bec7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.273391 Nov 02 07:30:26.312572 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 73/136] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:26 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:26.391476 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1eff7ab1-c213-465e-bdff-9763f73c59f9 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:26.393991 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1eff7ab1-c213-465e-bdff-9763f73c59f9 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:26.401738 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1eff7ab1-c213-465e-bdff-9763f73c59f9 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:26.402843 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1eff7ab1-c213-465e-bdff-9763f73c59f9 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:26.403469 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1eff7ab1-c213-465e-bdff-9763f73c59f9 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:26.405631 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1eff7ab1-c213-465e-bdff-9763f73c59f9 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:26.406290 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1eff7ab1-c213-465e-bdff-9763f73c59f9 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:26.407040 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1eff7ab1-c213-465e-bdff-9763f73c59f9 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:26.423481 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-1eff7ab1-c213-465e-bdff-9763f73c59f9 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] HTTP exception thrown: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1eff7ab1-c213-465e-bdff-9763f73c59f9 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Request method failure captured: Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef/os-volume_attachments HTTP/1.1 Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhxYKQxG0r_dI8Hf7PcZ85NXr8TYjIhOnphM8AWlrOY1REaHnLO8Pv2yRP4OQWDdbOCEPeEZc2cNpIbd5-rvjQMDx7OhirJd82ZWoFvFVpfRJsb3kEpx2ZTOVHrhWDvsye9TfrQPSqmjwy42kqAIwNBTfihp3f6HtesUvkpjy8jBjRQ Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: f676ec82a80f4425a6fa7562ee47a4cf Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-DeleteServersTestJSON-1091788271 Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:30:26.425947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:30:26.427377 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f676ec82a80f4425a6fa7562ee47a4cf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f676ec82a80f4425a6fa7562ee47a4cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f676ec82a80f4425a6fa7562ee47a4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f676ec82a80f4425a6fa7562ee47a4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:30:26.427377 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-DeleteServersTestJSON-1091788271 Nov 02 07:30:26.427377 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: f676ec82a80f4425a6fa7562ee47a4cf Nov 02 07:30:26.427377 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-DeleteServersTestJSON-1091788271 Nov 02 07:30:26.427377 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-DeleteServersTestJSON-1091788271-project Nov 02 07:30:26.427377 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:30:26.427377 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:30:26.427377 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 17a6f8d01e6d433ca467238f07ec15ba Nov 02 07:30:26.427377 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-DeleteServersTestJSON-1091788271-project Nov 02 07:30:26.427377 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:30:26.427377 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:26.427377 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'server_id': '7b5d6941-4c0e-4d53-94a7-70dcc586fbef'} Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:30:26.428033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:26.429165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:30:26.432627 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1eff7ab1-c213-465e-bdff-9763f73c59f9 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Returning 404 to user: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:30:26.433801 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-1eff7ab1-c213-465e-bdff-9763f73c59f9 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047555 Nov 02 07:30:26.438882 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 64/137] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 07:30:26 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:30:27.334897 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a0c9eb5f-a6d9-42c7-b408-c9e3a3667568 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:27.335672 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a0c9eb5f-a6d9-42c7-b408-c9e3a3667568 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:27.347449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a0c9eb5f-a6d9-42c7-b408-c9e3a3667568 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:27.347949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a0c9eb5f-a6d9-42c7-b408-c9e3a3667568 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:27.348388 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a0c9eb5f-a6d9-42c7-b408-c9e3a3667568 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:27.349391 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a0c9eb5f-a6d9-42c7-b408-c9e3a3667568 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:27.349534 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a0c9eb5f-a6d9-42c7-b408-c9e3a3667568 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:27.354075 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a0c9eb5f-a6d9-42c7-b408-c9e3a3667568 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:27.543854 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a0c9eb5f-a6d9-42c7-b408-c9e3a3667568 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:27.555413 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a0c9eb5f-a6d9-42c7-b408-c9e3a3667568 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.224487 Nov 02 07:30:27.556592 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 74/138] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:27 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:28.583410 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3dba7e4b-a6f8-4375-b7bd-93876fc9d074 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:28.584279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3dba7e4b-a6f8-4375-b7bd-93876fc9d074 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:28.598024 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3dba7e4b-a6f8-4375-b7bd-93876fc9d074 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:28.600636 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3dba7e4b-a6f8-4375-b7bd-93876fc9d074 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:28.601408 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3dba7e4b-a6f8-4375-b7bd-93876fc9d074 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:28.602200 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3dba7e4b-a6f8-4375-b7bd-93876fc9d074 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:28.603275 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3dba7e4b-a6f8-4375-b7bd-93876fc9d074 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:28.605959 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3dba7e4b-a6f8-4375-b7bd-93876fc9d074 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:28.813185 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3dba7e4b-a6f8-4375-b7bd-93876fc9d074 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:28.828892 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3dba7e4b-a6f8-4375-b7bd-93876fc9d074 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.250001 Nov 02 07:30:28.829785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 65/139] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:28 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:28.881373 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-6d5a8649-d022-43c6-b710-4aacdd79392e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:28.882065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-6d5a8649-d022-43c6-b710-4aacdd79392e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:28.892242 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6d5a8649-d022-43c6-b710-4aacdd79392e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:28.892735 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6d5a8649-d022-43c6-b710-4aacdd79392e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:28.893228 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6d5a8649-d022-43c6-b710-4aacdd79392e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:28.894088 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6d5a8649-d022-43c6-b710-4aacdd79392e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:28.894682 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6d5a8649-d022-43c6-b710-4aacdd79392e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:28.895016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6d5a8649-d022-43c6-b710-4aacdd79392e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:28.925557 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-6d5a8649-d022-43c6-b710-4aacdd79392e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] HTTP exception thrown: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-6d5a8649-d022-43c6-b710-4aacdd79392e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Request method failure captured: Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: DELETE /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef HTTP/1.1 Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhxYKQxG0r_dI8Hf7PcZ85NXr8TYjIhOnphM8AWlrOY1REaHnLO8Pv2yRP4OQWDdbOCEPeEZc2cNpIbd5-rvjQMDx7OhirJd82ZWoFvFVpfRJsb3kEpx2ZTOVHrhWDvsye9TfrQPSqmjwy42kqAIwNBTfihp3f6HtesUvkpjy8jBjRQ Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: f676ec82a80f4425a6fa7562ee47a4cf Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-DeleteServersTestJSON-1091788271 Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:30:28.932550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:30:28.934006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f676ec82a80f4425a6fa7562ee47a4cf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f676ec82a80f4425a6fa7562ee47a4cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f676ec82a80f4425a6fa7562ee47a4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f676ec82a80f4425a6fa7562ee47a4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:30:28.934006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-DeleteServersTestJSON-1091788271 Nov 02 07:30:28.934006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: f676ec82a80f4425a6fa7562ee47a4cf Nov 02 07:30:28.934006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-DeleteServersTestJSON-1091788271 Nov 02 07:30:28.934006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-DeleteServersTestJSON-1091788271-project Nov 02 07:30:28.934006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:30:28.934006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:30:28.934006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 17a6f8d01e6d433ca467238f07ec15ba Nov 02 07:30:28.934006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-DeleteServersTestJSON-1091788271-project Nov 02 07:30:28.934006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:30:28.934006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:28.934006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': '7b5d6941-4c0e-4d53-94a7-70dcc586fbef'} Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:30:28.934917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:28.936139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:30:28.938912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-6d5a8649-d022-43c6-b710-4aacdd79392e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Returning 404 to user: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:30:28.940504 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-6d5a8649-d022-43c6-b710-4aacdd79392e tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 404 len: 111 microversion: 2.1 time: 0.062428 Nov 02 07:30:28.941533 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 75/140] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:30:28 2022] DELETE /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:30:28.951479 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-4ba5bb27-f80b-47c7-a283-80f5d50e2220 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:28.952143 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-4ba5bb27-f80b-47c7-a283-80f5d50e2220 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] [instance: 7b5d6941-4c0e-4d53-94a7-70dcc586fbef] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:28.960113 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4ba5bb27-f80b-47c7-a283-80f5d50e2220 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:28.960763 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4ba5bb27-f80b-47c7-a283-80f5d50e2220 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:28.961336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4ba5bb27-f80b-47c7-a283-80f5d50e2220 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:28.964196 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4ba5bb27-f80b-47c7-a283-80f5d50e2220 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:28.964812 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4ba5bb27-f80b-47c7-a283-80f5d50e2220 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:28.965378 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4ba5bb27-f80b-47c7-a283-80f5d50e2220 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:28.985436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-4ba5bb27-f80b-47c7-a283-80f5d50e2220 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] HTTP exception thrown: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-4ba5bb27-f80b-47c7-a283-80f5d50e2220 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Request method failure captured: Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef HTTP/1.1 Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhxYKQxG0r_dI8Hf7PcZ85NXr8TYjIhOnphM8AWlrOY1REaHnLO8Pv2yRP4OQWDdbOCEPeEZc2cNpIbd5-rvjQMDx7OhirJd82ZWoFvFVpfRJsb3kEpx2ZTOVHrhWDvsye9TfrQPSqmjwy42kqAIwNBTfihp3f6HtesUvkpjy8jBjRQ Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: f676ec82a80f4425a6fa7562ee47a4cf Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-DeleteServersTestJSON-1091788271 Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:30:28.987336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:30:28.988969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f676ec82a80f4425a6fa7562ee47a4cf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f676ec82a80f4425a6fa7562ee47a4cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f676ec82a80f4425a6fa7562ee47a4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f676ec82a80f4425a6fa7562ee47a4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:30:28.988969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-DeleteServersTestJSON-1091788271 Nov 02 07:30:28.988969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: f676ec82a80f4425a6fa7562ee47a4cf Nov 02 07:30:28.988969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-DeleteServersTestJSON-1091788271 Nov 02 07:30:28.988969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-DeleteServersTestJSON-1091788271-project Nov 02 07:30:28.988969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:30:28.988969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:30:28.988969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 17a6f8d01e6d433ca467238f07ec15ba Nov 02 07:30:28.988969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-DeleteServersTestJSON-1091788271-project Nov 02 07:30:28.988969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:30:28.988969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:28.988969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '7b5d6941-4c0e-4d53-94a7-70dcc586fbef'} Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:30:28.989628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. Nov 02 07:30:28.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:30:28.995633 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-4ba5bb27-f80b-47c7-a283-80f5d50e2220 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] Returning 404 to user: Instance 7b5d6941-4c0e-4d53-94a7-70dcc586fbef could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:30:28.996797 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-4ba5bb27-f80b-47c7-a283-80f5d50e2220 tempest-DeleteServersTestJSON-1091788271 tempest-DeleteServersTestJSON-1091788271-project] 10.222.0.18 "GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef" status: 404 len: 111 microversion: 2.1 time: 0.051232 Nov 02 07:30:29.004471 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 66/141] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:28 2022] GET /compute/v2.1/servers/7b5d6941-4c0e-4d53-94a7-70dcc586fbef => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:30:29.397437 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-289205079", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452"}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:30:29.535154 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.network.neutron [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] validate_networks() for None {{(pid=118991) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:30:29.854290 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e4f69d37-fd16-4724-bdb4-286a9aa8bac1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:29.855534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e4f69d37-fd16-4724-bdb4-286a9aa8bac1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:29.863321 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e4f69d37-fd16-4724-bdb4-286a9aa8bac1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:29.864157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e4f69d37-fd16-4724-bdb4-286a9aa8bac1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:29.864801 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e4f69d37-fd16-4724-bdb4-286a9aa8bac1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:29.865723 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e4f69d37-fd16-4724-bdb4-286a9aa8bac1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:29.866394 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e4f69d37-fd16-4724-bdb4-286a9aa8bac1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:29.867023 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e4f69d37-fd16-4724-bdb4-286a9aa8bac1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:30.343847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Flavor limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:30:30.345301 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Image limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:30:30.345925 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Flavor pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:30:30.346617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Image pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:30:30.347480 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:30:30.368652 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:30.369395 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:30.369984 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:30.371068 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:30.371529 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:30.375005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:30.397519 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-e4f69d37-fd16-4724-bdb4-286a9aa8bac1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:30.405396 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e4f69d37-fd16-4724-bdb4-286a9aa8bac1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.554789 Nov 02 07:30:30.405976 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 67/142] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:29 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:30:30.415799 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Getting quotas for project 71f746654bee4209b28de275a9ce5116. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:30:30.445282 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Getting quotas for user db5d8789175745d398d0011f616785c9 and project 71f746654bee4209b28de275a9ce5116. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:30:30.474852 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Going to run 1 instances... {{(pid=118991) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:30:30.479841 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:30:30.564574 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2b99a199-1dc9-4505-87fb-01887839b6ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171667 Nov 02 07:30:30.571526 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 76/143] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:30:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 07:30:30.576237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-23c2c108-20d8-459c-9c31-c85d82ad778f tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:30.576853 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-23c2c108-20d8-459c-9c31-c85d82ad778f tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:30.745133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-23c2c108-20d8-459c-9c31-c85d82ad778f tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:30.756663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-23c2c108-20d8-459c-9c31-c85d82ad778f tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1214 microversion: 2.1 time: 0.184170 Nov 02 07:30:30.757243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 68/144] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:30 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:31.433374 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-13c54c86-a91c-41a6-94f0-6d0fc76d7b5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:31.434656 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-13c54c86-a91c-41a6-94f0-6d0fc76d7b5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:31.452993 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13c54c86-a91c-41a6-94f0-6d0fc76d7b5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:31.456141 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13c54c86-a91c-41a6-94f0-6d0fc76d7b5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:31.456709 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13c54c86-a91c-41a6-94f0-6d0fc76d7b5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:31.457885 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13c54c86-a91c-41a6-94f0-6d0fc76d7b5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:31.458258 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13c54c86-a91c-41a6-94f0-6d0fc76d7b5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:31.460388 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13c54c86-a91c-41a6-94f0-6d0fc76d7b5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:31.784268 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6fd7145d-bfc0-44ef-b2d6-1d3f9382f882 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:31.785718 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-6fd7145d-bfc0-44ef-b2d6-1d3f9382f882 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:31.810027 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6fd7145d-bfc0-44ef-b2d6-1d3f9382f882 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:31.811577 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6fd7145d-bfc0-44ef-b2d6-1d3f9382f882 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:31.812161 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6fd7145d-bfc0-44ef-b2d6-1d3f9382f882 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:31.813153 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6fd7145d-bfc0-44ef-b2d6-1d3f9382f882 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:31.813820 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6fd7145d-bfc0-44ef-b2d6-1d3f9382f882 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:31.814428 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6fd7145d-bfc0-44ef-b2d6-1d3f9382f882 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:31.939916 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-13c54c86-a91c-41a6-94f0-6d0fc76d7b5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:31.953813 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-13c54c86-a91c-41a6-94f0-6d0fc76d7b5a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.526128 Nov 02 07:30:31.954487 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 77/145] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:31 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:30:31.992692 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-6fd7145d-bfc0-44ef-b2d6-1d3f9382f882 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:32.002029 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-6fd7145d-bfc0-44ef-b2d6-1d3f9382f882 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1210 microversion: 2.1 time: 0.221602 Nov 02 07:30:32.017099 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 69/146] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:31 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1210 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:30:32.978111 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5bdc79c0-ec43-460b-853a-3689fb076bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:32.978783 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-5bdc79c0-ec43-460b-853a-3689fb076bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:32.988200 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5bdc79c0-ec43-460b-853a-3689fb076bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:32.989004 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5bdc79c0-ec43-460b-853a-3689fb076bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:32.989696 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5bdc79c0-ec43-460b-853a-3689fb076bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:32.990663 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5bdc79c0-ec43-460b-853a-3689fb076bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:32.991254 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5bdc79c0-ec43-460b-853a-3689fb076bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:32.992636 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5bdc79c0-ec43-460b-853a-3689fb076bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:33.040997 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-8f2bd908-734d-43c6-a666-11edd7f205fb tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:33.042395 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-8f2bd908-734d-43c6-a666-11edd7f205fb tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:33.051853 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8f2bd908-734d-43c6-a666-11edd7f205fb tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:33.057583 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8f2bd908-734d-43c6-a666-11edd7f205fb tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:33.058216 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8f2bd908-734d-43c6-a666-11edd7f205fb tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:33.061975 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8f2bd908-734d-43c6-a666-11edd7f205fb tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:33.065115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8f2bd908-734d-43c6-a666-11edd7f205fb tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:33.067472 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8f2bd908-734d-43c6-a666-11edd7f205fb tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:33.309282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-8f2bd908-734d-43c6-a666-11edd7f205fb tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:33.322271 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-8f2bd908-734d-43c6-a666-11edd7f205fb tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1284 microversion: 2.1 time: 0.285025 Nov 02 07:30:33.335331 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 70/147] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:33 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1284 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:33.677412 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-5bdc79c0-ec43-460b-853a-3689fb076bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:33.697187 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-5bdc79c0-ec43-460b-853a-3689fb076bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.717686 Nov 02 07:30:33.702027 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 78/148] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:32 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:34.354572 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-aa9d8949-dea3-4f35-b5fb-ad1dd596d606 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:34.355894 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-aa9d8949-dea3-4f35-b5fb-ad1dd596d606 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:34.373050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa9d8949-dea3-4f35-b5fb-ad1dd596d606 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:34.373789 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa9d8949-dea3-4f35-b5fb-ad1dd596d606 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:34.374379 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa9d8949-dea3-4f35-b5fb-ad1dd596d606 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:34.375226 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa9d8949-dea3-4f35-b5fb-ad1dd596d606 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:34.378821 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa9d8949-dea3-4f35-b5fb-ad1dd596d606 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:34.379405 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa9d8949-dea3-4f35-b5fb-ad1dd596d606 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:34.512744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-aa9d8949-dea3-4f35-b5fb-ad1dd596d606 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:34.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-aa9d8949-dea3-4f35-b5fb-ad1dd596d606 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1272 microversion: 2.1 time: 0.172489 Nov 02 07:30:34.531868 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 71/149] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:34 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:34.725797 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f890d28d-f9b8-427a-b915-f013a6530367 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:34.727164 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f890d28d-f9b8-427a-b915-f013a6530367 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:34.736920 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f890d28d-f9b8-427a-b915-f013a6530367 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:34.737672 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f890d28d-f9b8-427a-b915-f013a6530367 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:34.741842 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f890d28d-f9b8-427a-b915-f013a6530367 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:34.743391 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f890d28d-f9b8-427a-b915-f013a6530367 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:34.744015 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f890d28d-f9b8-427a-b915-f013a6530367 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:34.744613 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f890d28d-f9b8-427a-b915-f013a6530367 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:35.548852 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-83006d0e-0ea1-4e22-94f9-453d608b9c48 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:35.549646 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-83006d0e-0ea1-4e22-94f9-453d608b9c48 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:35.567286 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83006d0e-0ea1-4e22-94f9-453d608b9c48 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:35.568220 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83006d0e-0ea1-4e22-94f9-453d608b9c48 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:35.571607 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83006d0e-0ea1-4e22-94f9-453d608b9c48 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:35.572083 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f890d28d-f9b8-427a-b915-f013a6530367 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:35.574694 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83006d0e-0ea1-4e22-94f9-453d608b9c48 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:35.578134 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83006d0e-0ea1-4e22-94f9-453d608b9c48 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:35.581033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83006d0e-0ea1-4e22-94f9-453d608b9c48 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:35.584569 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f890d28d-f9b8-427a-b915-f013a6530367 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.863677 Nov 02 07:30:35.586225 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 79/150] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:34 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:35.722131 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-83006d0e-0ea1-4e22-94f9-453d608b9c48 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:35.731630 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-83006d0e-0ea1-4e22-94f9-453d608b9c48 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1272 microversion: 2.1 time: 0.186629 Nov 02 07:30:35.734916 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 72/151] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:35 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:30:36.614067 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a641fcdb-d8e7-46ee-96c3-4105f584f518 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:36.615420 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a641fcdb-d8e7-46ee-96c3-4105f584f518 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:36.623230 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a641fcdb-d8e7-46ee-96c3-4105f584f518 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:36.624798 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a641fcdb-d8e7-46ee-96c3-4105f584f518 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:36.625500 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a641fcdb-d8e7-46ee-96c3-4105f584f518 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:36.626552 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a641fcdb-d8e7-46ee-96c3-4105f584f518 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:36.627229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a641fcdb-d8e7-46ee-96c3-4105f584f518 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:36.627863 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a641fcdb-d8e7-46ee-96c3-4105f584f518 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:36.758826 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-76df685d-2ba4-45e9-a7d7-c513fedf055a tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:36.759583 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-76df685d-2ba4-45e9-a7d7-c513fedf055a tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:36.767725 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76df685d-2ba4-45e9-a7d7-c513fedf055a tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:36.769116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76df685d-2ba4-45e9-a7d7-c513fedf055a tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:36.769826 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76df685d-2ba4-45e9-a7d7-c513fedf055a tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:36.770833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76df685d-2ba4-45e9-a7d7-c513fedf055a tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:36.771461 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76df685d-2ba4-45e9-a7d7-c513fedf055a tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:36.772121 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76df685d-2ba4-45e9-a7d7-c513fedf055a tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:36.872229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a641fcdb-d8e7-46ee-96c3-4105f584f518 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:36.881363 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a641fcdb-d8e7-46ee-96c3-4105f584f518 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.271118 Nov 02 07:30:36.882206 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 80/152] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:36 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:37.216055 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-76df685d-2ba4-45e9-a7d7-c513fedf055a tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:37.225632 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-76df685d-2ba4-45e9-a7d7-c513fedf055a tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1314 microversion: 2.1 time: 0.470486 Nov 02 07:30:37.239119 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 73/153] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:36 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:37.615776 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ea651c00-0956-4d18-a070-0aef00c78a70 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Action: 'create', calling method: .version_select at 0x7f4d6a3fbca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-823697442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk5xMDaBJFsS9QXJgSaSUV61/qK43y3sR4lyxeuNEWYYhKZ/xJVdy1dXZ8DEDzii3A2VJMYn+UI06qYYl4E3vKooqCGg+57ZIBZ1SAllgxsDM2u3n0CsnJBneHHwP0pOQ=="}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:30:37.680836 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-ea651c00-0956-4d18-a070-0aef00c78a70 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Getting quotas for project 566514b413e24aaebe69c11ce2159ac9. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:30:37.687013 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-ea651c00-0956-4d18-a070-0aef00c78a70 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Getting quotas for user fe26aea6bb9d4dcebf046da719b2c244 and project 566514b413e24aaebe69c11ce2159ac9. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:30:37.787510 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ea651c00-0956-4d18-a070-0aef00c78a70 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.573173 Nov 02 07:30:37.789419 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 81/154] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 07:30:37 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:30:37.916261 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f338dd36-6e60-4b49-8095-8ce737e224a4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:37.919108 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f338dd36-6e60-4b49-8095-8ce737e224a4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:37.941575 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f338dd36-6e60-4b49-8095-8ce737e224a4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:37.957252 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f338dd36-6e60-4b49-8095-8ce737e224a4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:37.965104 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f338dd36-6e60-4b49-8095-8ce737e224a4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:37.971272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f338dd36-6e60-4b49-8095-8ce737e224a4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:37.981125 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f338dd36-6e60-4b49-8095-8ce737e224a4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:37.982787 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f338dd36-6e60-4b49-8095-8ce737e224a4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:38.119604 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=100 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:38.254799 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ad20ca96-e04b-44bb-b3e5-24594254826b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:38.255603 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-ad20ca96-e04b-44bb-b3e5-24594254826b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:38.277668 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ad20ca96-e04b-44bb-b3e5-24594254826b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:38.279966 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ad20ca96-e04b-44bb-b3e5-24594254826b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:38.283954 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ad20ca96-e04b-44bb-b3e5-24594254826b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:38.294341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ad20ca96-e04b-44bb-b3e5-24594254826b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:38.297002 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ad20ca96-e04b-44bb-b3e5-24594254826b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:38.298101 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ad20ca96-e04b-44bb-b3e5-24594254826b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:38.739263 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f338dd36-6e60-4b49-8095-8ce737e224a4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:38.753388 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f338dd36-6e60-4b49-8095-8ce737e224a4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.847174 Nov 02 07:30:38.762477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 74/155] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:37 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:38.960288 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ad20ca96-e04b-44bb-b3e5-24594254826b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:39.003614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ad20ca96-e04b-44bb-b3e5-24594254826b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1314 microversion: 2.1 time: 0.756236 Nov 02 07:30:39.008951 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 82/156] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:38 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1314 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:39.375176 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-3ef865b3-a320-47ed-a9b0-3f51adb867a7 req-fe99a742-3842-4e55-817a-dc5de99dd678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2925e4e-7067-440f-ab0e-8fa62a7ffc56", "tag": "0de2fcbc-76ab-4e2d-bb47-2d60ec17b2a5"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:30:39.413427 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-3ef865b3-a320-47ed-a9b0-3f51adb867a7 req-fe99a742-3842-4e55-817a-dc5de99dd678 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:39.413903 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-3ef865b3-a320-47ed-a9b0-3f51adb867a7 req-fe99a742-3842-4e55-817a-dc5de99dd678 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:39.414331 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-3ef865b3-a320-47ed-a9b0-3f51adb867a7 req-fe99a742-3842-4e55-817a-dc5de99dd678 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:39.475061 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-3ef865b3-a320-47ed-a9b0-3f51adb867a7 req-fe99a742-3842-4e55-817a-dc5de99dd678 service nova] Creating event network-changed:0de2fcbc-76ab-4e2d-bb47-2d60ec17b2a5 for instance e2925e4e-7067-440f-ab0e-8fa62a7ffc56 on hv-cinder-80473 Nov 02 07:30:39.495468 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-3ef865b3-a320-47ed-a9b0-3f51adb867a7 req-fe99a742-3842-4e55-817a-dc5de99dd678 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121686 Nov 02 07:30:39.496285 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 75/157] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:30:39.791635 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a6e56fe6-0035-43ee-a113-83b0663998ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:39.792442 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a6e56fe6-0035-43ee-a113-83b0663998ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:39.806319 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6e56fe6-0035-43ee-a113-83b0663998ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:39.812835 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6e56fe6-0035-43ee-a113-83b0663998ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:39.814296 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6e56fe6-0035-43ee-a113-83b0663998ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:39.815321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6e56fe6-0035-43ee-a113-83b0663998ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:39.820030 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6e56fe6-0035-43ee-a113-83b0663998ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:39.821476 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6e56fe6-0035-43ee-a113-83b0663998ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:40.035828 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-5bb65cd2-fc03-403c-a405-5034cc812601 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:40.036876 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-5bb65cd2-fc03-403c-a405-5034cc812601 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:40.057135 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5bb65cd2-fc03-403c-a405-5034cc812601 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:40.057974 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5bb65cd2-fc03-403c-a405-5034cc812601 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:40.059213 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5bb65cd2-fc03-403c-a405-5034cc812601 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:40.066300 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5bb65cd2-fc03-403c-a405-5034cc812601 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:40.068234 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5bb65cd2-fc03-403c-a405-5034cc812601 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:40.070123 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5bb65cd2-fc03-403c-a405-5034cc812601 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:40.400706 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:40.749898 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:41.554036 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a6e56fe6-0035-43ee-a113-83b0663998ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:41.566431 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a6e56fe6-0035-43ee-a113-83b0663998ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 1.775514 Nov 02 07:30:41.569211 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 83/158] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:39 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:41.657872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-5bb65cd2-fc03-403c-a405-5034cc812601 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:41.678667 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-5bb65cd2-fc03-403c-a405-5034cc812601 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1314 microversion: 2.1 time: 1.645327 Nov 02 07:30:41.679871 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 76/159] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:40 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1314 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:30:42.595870 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-51df158d-48ec-4a60-b9ee-acfabfb94068 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:42.596582 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-51df158d-48ec-4a60-b9ee-acfabfb94068 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:42.611850 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-51df158d-48ec-4a60-b9ee-acfabfb94068 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:42.613304 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-51df158d-48ec-4a60-b9ee-acfabfb94068 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:42.613756 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-51df158d-48ec-4a60-b9ee-acfabfb94068 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:42.618719 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-51df158d-48ec-4a60-b9ee-acfabfb94068 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:42.621373 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-51df158d-48ec-4a60-b9ee-acfabfb94068 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:42.623614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-51df158d-48ec-4a60-b9ee-acfabfb94068 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:42.718268 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f15d0538-5ced-4478-98b7-aa10098768a8 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:42.719814 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f15d0538-5ced-4478-98b7-aa10098768a8 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:42.728618 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f15d0538-5ced-4478-98b7-aa10098768a8 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:42.729700 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f15d0538-5ced-4478-98b7-aa10098768a8 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:42.730786 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f15d0538-5ced-4478-98b7-aa10098768a8 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:42.734577 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f15d0538-5ced-4478-98b7-aa10098768a8 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:42.735852 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f15d0538-5ced-4478-98b7-aa10098768a8 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:42.736952 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f15d0538-5ced-4478-98b7-aa10098768a8 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:43.244828 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f15d0538-5ced-4478-98b7-aa10098768a8 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:43.260133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f15d0538-5ced-4478-98b7-aa10098768a8 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1314 microversion: 2.1 time: 0.556237 Nov 02 07:30:43.260812 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 77/160] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:42 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:43.368893 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-51df158d-48ec-4a60-b9ee-acfabfb94068 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:43.382731 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-51df158d-48ec-4a60-b9ee-acfabfb94068 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.791635 Nov 02 07:30:43.383666 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 84/161] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:42 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:44.288347 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f9338b82-2cfc-40c8-b58c-c49f1729a741 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:44.289716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f9338b82-2cfc-40c8-b58c-c49f1729a741 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:44.307062 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9338b82-2cfc-40c8-b58c-c49f1729a741 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:44.307809 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9338b82-2cfc-40c8-b58c-c49f1729a741 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:44.308404 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9338b82-2cfc-40c8-b58c-c49f1729a741 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:44.311502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9338b82-2cfc-40c8-b58c-c49f1729a741 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:44.319931 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9338b82-2cfc-40c8-b58c-c49f1729a741 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:44.319931 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9338b82-2cfc-40c8-b58c-c49f1729a741 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:44.426845 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-77aa0365-959a-4d16-aa05-e2a7540d19ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:44.429856 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-77aa0365-959a-4d16-aa05-e2a7540d19ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:44.446672 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-77aa0365-959a-4d16-aa05-e2a7540d19ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:44.447415 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-77aa0365-959a-4d16-aa05-e2a7540d19ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:44.449886 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-77aa0365-959a-4d16-aa05-e2a7540d19ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:44.452631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-77aa0365-959a-4d16-aa05-e2a7540d19ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:44.453359 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-77aa0365-959a-4d16-aa05-e2a7540d19ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:44.454014 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-77aa0365-959a-4d16-aa05-e2a7540d19ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:44.677193 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f9338b82-2cfc-40c8-b58c-c49f1729a741 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:44.722700 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f9338b82-2cfc-40c8-b58c-c49f1729a741 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1314 microversion: 2.1 time: 0.431376 Nov 02 07:30:44.734693 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 78/162] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:44 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:44.923472 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-77aa0365-959a-4d16-aa05-e2a7540d19ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:44.940792 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-77aa0365-959a-4d16-aa05-e2a7540d19ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.532727 Nov 02 07:30:44.941791 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 85/163] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:44 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:45.755409 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f09687a0-982e-4400-bc7c-6c7e3abe3e22 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:45.756655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f09687a0-982e-4400-bc7c-6c7e3abe3e22 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:45.774079 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f09687a0-982e-4400-bc7c-6c7e3abe3e22 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:45.776325 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f09687a0-982e-4400-bc7c-6c7e3abe3e22 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:45.777091 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f09687a0-982e-4400-bc7c-6c7e3abe3e22 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:45.782553 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f09687a0-982e-4400-bc7c-6c7e3abe3e22 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:45.784470 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f09687a0-982e-4400-bc7c-6c7e3abe3e22 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:45.786726 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f09687a0-982e-4400-bc7c-6c7e3abe3e22 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:45.971776 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-32feda87-0e91-4642-b683-6bf0d7c8e7e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:45.973877 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-32feda87-0e91-4642-b683-6bf0d7c8e7e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:45.984012 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-32feda87-0e91-4642-b683-6bf0d7c8e7e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:45.984896 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-32feda87-0e91-4642-b683-6bf0d7c8e7e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:45.986413 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-32feda87-0e91-4642-b683-6bf0d7c8e7e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:45.987857 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-32feda87-0e91-4642-b683-6bf0d7c8e7e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:45.989136 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-32feda87-0e91-4642-b683-6bf0d7c8e7e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:45.989546 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-32feda87-0e91-4642-b683-6bf0d7c8e7e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:46.281607 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f09687a0-982e-4400-bc7c-6c7e3abe3e22 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:46.304342 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f09687a0-982e-4400-bc7c-6c7e3abe3e22 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1314 microversion: 2.1 time: 0.554561 Nov 02 07:30:46.308250 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 79/164] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:45 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:46.715978 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-32feda87-0e91-4642-b683-6bf0d7c8e7e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:46.729001 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-32feda87-0e91-4642-b683-6bf0d7c8e7e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.760087 Nov 02 07:30:46.733971 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 86/165] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:45 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:47.339800 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-161c93c9-bc42-4ad5-970b-0e0bb1480817 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:47.340602 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-161c93c9-bc42-4ad5-970b-0e0bb1480817 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:47.363736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-161c93c9-bc42-4ad5-970b-0e0bb1480817 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:47.365678 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-161c93c9-bc42-4ad5-970b-0e0bb1480817 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:47.367677 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-161c93c9-bc42-4ad5-970b-0e0bb1480817 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:47.368958 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-161c93c9-bc42-4ad5-970b-0e0bb1480817 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:47.370715 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-161c93c9-bc42-4ad5-970b-0e0bb1480817 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:47.372024 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-161c93c9-bc42-4ad5-970b-0e0bb1480817 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:47.767109 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-13332fdc-8b3a-4ed6-97cf-257543d8e527 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:47.767714 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-13332fdc-8b3a-4ed6-97cf-257543d8e527 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:47.784829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=10 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:47.797298 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13332fdc-8b3a-4ed6-97cf-257543d8e527 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:47.798258 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13332fdc-8b3a-4ed6-97cf-257543d8e527 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:47.799256 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13332fdc-8b3a-4ed6-97cf-257543d8e527 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:47.800305 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13332fdc-8b3a-4ed6-97cf-257543d8e527 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:47.806185 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13332fdc-8b3a-4ed6-97cf-257543d8e527 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:47.806715 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13332fdc-8b3a-4ed6-97cf-257543d8e527 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:48.055901 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-161c93c9-bc42-4ad5-970b-0e0bb1480817 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:48.077771 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-161c93c9-bc42-4ad5-970b-0e0bb1480817 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1314 microversion: 2.1 time: 0.744492 Nov 02 07:30:48.081703 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 80/166] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:47 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1314 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:48.347560 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-13332fdc-8b3a-4ed6-97cf-257543d8e527 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:48.360863 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-13332fdc-8b3a-4ed6-97cf-257543d8e527 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.602090 Nov 02 07:30:48.393865 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 87/167] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:47 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:30:49.125871 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ee8da5cc-1088-492f-b67e-705294bb6694 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:49.129080 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ee8da5cc-1088-492f-b67e-705294bb6694 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:49.143350 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ee8da5cc-1088-492f-b67e-705294bb6694 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:49.144045 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ee8da5cc-1088-492f-b67e-705294bb6694 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:49.147254 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ee8da5cc-1088-492f-b67e-705294bb6694 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:49.149160 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ee8da5cc-1088-492f-b67e-705294bb6694 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:49.149997 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ee8da5cc-1088-492f-b67e-705294bb6694 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:49.151538 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ee8da5cc-1088-492f-b67e-705294bb6694 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:49.389806 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ecfbd5d4-21a5-448b-b851-4f6f0e1576e3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:49.390471 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-ecfbd5d4-21a5-448b-b851-4f6f0e1576e3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:49.400939 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ecfbd5d4-21a5-448b-b851-4f6f0e1576e3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:49.405417 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ecfbd5d4-21a5-448b-b851-4f6f0e1576e3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:49.406044 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ecfbd5d4-21a5-448b-b851-4f6f0e1576e3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:49.407379 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ecfbd5d4-21a5-448b-b851-4f6f0e1576e3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:49.407987 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ecfbd5d4-21a5-448b-b851-4f6f0e1576e3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:49.408817 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ecfbd5d4-21a5-448b-b851-4f6f0e1576e3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:49.456211 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ee8da5cc-1088-492f-b67e-705294bb6694 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:49.465520 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ee8da5cc-1088-492f-b67e-705294bb6694 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1314 microversion: 2.1 time: 0.360190 Nov 02 07:30:49.467511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 81/168] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:49 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:49.665196 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ecfbd5d4-21a5-448b-b851-4f6f0e1576e3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:49.675765 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ecfbd5d4-21a5-448b-b851-4f6f0e1576e3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.291684 Nov 02 07:30:49.676639 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 88/169] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:49 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:50.144574 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-c610c834-0f19-4033-a457-2607398298fb req-c8790b79-d3b4-4ad5-a4a4-35ad44637958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2925e4e-7067-440f-ab0e-8fa62a7ffc56", "name": "network-vif-plugged", "status": "completed", "tag": "0de2fcbc-76ab-4e2d-bb47-2d60ec17b2a5"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:30:50.170843 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c610c834-0f19-4033-a457-2607398298fb req-c8790b79-d3b4-4ad5-a4a4-35ad44637958 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:50.171912 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c610c834-0f19-4033-a457-2607398298fb req-c8790b79-d3b4-4ad5-a4a4-35ad44637958 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:50.172510 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c610c834-0f19-4033-a457-2607398298fb req-c8790b79-d3b4-4ad5-a4a4-35ad44637958 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:50.189895 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-c610c834-0f19-4033-a457-2607398298fb req-c8790b79-d3b4-4ad5-a4a4-35ad44637958 service nova] Creating event network-vif-plugged:0de2fcbc-76ab-4e2d-bb47-2d60ec17b2a5 for instance e2925e4e-7067-440f-ab0e-8fa62a7ffc56 on hv-cinder-80473 Nov 02 07:30:50.207096 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-c610c834-0f19-4033-a457-2607398298fb req-c8790b79-d3b4-4ad5-a4a4-35ad44637958 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067842 Nov 02 07:30:50.210049 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 82/170] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:30:50.492954 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-20a49dce-b0c4-44da-99ea-5ded085cfb7b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:50.494218 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-20a49dce-b0c4-44da-99ea-5ded085cfb7b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:50.510902 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-20a49dce-b0c4-44da-99ea-5ded085cfb7b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:50.510902 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-20a49dce-b0c4-44da-99ea-5ded085cfb7b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:50.510902 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-20a49dce-b0c4-44da-99ea-5ded085cfb7b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:50.510902 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-20a49dce-b0c4-44da-99ea-5ded085cfb7b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:50.511200 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-20a49dce-b0c4-44da-99ea-5ded085cfb7b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:50.511200 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-20a49dce-b0c4-44da-99ea-5ded085cfb7b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:50.727211 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e66734de-0173-4e31-8c5c-98345a3bf18e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:50.729220 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e66734de-0173-4e31-8c5c-98345a3bf18e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:50.738438 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e66734de-0173-4e31-8c5c-98345a3bf18e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:50.739090 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e66734de-0173-4e31-8c5c-98345a3bf18e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:50.739828 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e66734de-0173-4e31-8c5c-98345a3bf18e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:50.752023 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e66734de-0173-4e31-8c5c-98345a3bf18e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:50.752678 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e66734de-0173-4e31-8c5c-98345a3bf18e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:50.753268 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e66734de-0173-4e31-8c5c-98345a3bf18e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:50.996485 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-20a49dce-b0c4-44da-99ea-5ded085cfb7b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:51.004995 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-20a49dce-b0c4-44da-99ea-5ded085cfb7b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1314 microversion: 2.1 time: 0.519503 Nov 02 07:30:51.025625 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 89/171] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:50 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:51.126672 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-e66734de-0173-4e31-8c5c-98345a3bf18e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:51.135191 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e66734de-0173-4e31-8c5c-98345a3bf18e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.431014 Nov 02 07:30:51.139366 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 83/172] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:50 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:30:52.036011 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d1ed8e4b-3d13-45a8-a16b-3c84b7527a71 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:52.037188 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-d1ed8e4b-3d13-45a8-a16b-3c84b7527a71 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:52.045232 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d1ed8e4b-3d13-45a8-a16b-3c84b7527a71 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:52.045959 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d1ed8e4b-3d13-45a8-a16b-3c84b7527a71 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:52.046419 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d1ed8e4b-3d13-45a8-a16b-3c84b7527a71 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:52.047129 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d1ed8e4b-3d13-45a8-a16b-3c84b7527a71 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:52.052814 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d1ed8e4b-3d13-45a8-a16b-3c84b7527a71 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:52.053412 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d1ed8e4b-3d13-45a8-a16b-3c84b7527a71 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:52.163849 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e7d8575a-c489-436c-8edf-791b7ed669ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:52.164539 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e7d8575a-c489-436c-8edf-791b7ed669ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:52.171401 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e7d8575a-c489-436c-8edf-791b7ed669ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:52.171878 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e7d8575a-c489-436c-8edf-791b7ed669ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:52.172312 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e7d8575a-c489-436c-8edf-791b7ed669ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:52.173123 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e7d8575a-c489-436c-8edf-791b7ed669ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:52.173740 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e7d8575a-c489-436c-8edf-791b7ed669ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:52.174172 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e7d8575a-c489-436c-8edf-791b7ed669ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:52.431075 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d1ed8e4b-3d13-45a8-a16b-3c84b7527a71 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:52.459242 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d1ed8e4b-3d13-45a8-a16b-3c84b7527a71 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1314 microversion: 2.1 time: 0.430245 Nov 02 07:30:52.460360 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 90/173] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:52 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:52.494172 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-e7d8575a-c489-436c-8edf-791b7ed669ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:52.505675 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e7d8575a-c489-436c-8edf-791b7ed669ef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.345440 Nov 02 07:30:52.508766 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 84/174] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:52 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:53.496079 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e6facd1b-7fd5-4564-89f5-f26fc1d1ffe9 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:53.496805 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e6facd1b-7fd5-4564-89f5-f26fc1d1ffe9 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:53.503755 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e6facd1b-7fd5-4564-89f5-f26fc1d1ffe9 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:53.504239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e6facd1b-7fd5-4564-89f5-f26fc1d1ffe9 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:53.504666 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e6facd1b-7fd5-4564-89f5-f26fc1d1ffe9 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:53.505349 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e6facd1b-7fd5-4564-89f5-f26fc1d1ffe9 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:53.505792 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e6facd1b-7fd5-4564-89f5-f26fc1d1ffe9 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:53.506207 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e6facd1b-7fd5-4564-89f5-f26fc1d1ffe9 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:53.593912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0e435841-2a90-4af0-a437-b6907959e8f6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Action: 'create', calling method: .version_select at 0x7f4d6a78a4c0>, body: {"keypair": {"name": "tempest-keypair-375419057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJngiyI98xsAZPcWzrulBSlM/e7kh9e4IMrXoRVG9tZcvXxz74AAY1FtZtj1ymh2leDoP2Kaeoc+MOSZ+9bEa9rFe0y+koImP8VrW7Ub7uW8ghSp1R0qbHNx5Afs+qJLzg=="}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:30:53.612438 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-0e435841-2a90-4af0-a437-b6907959e8f6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Getting quotas for project ba3bab98d31d49098a8e7242d51be646. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:30:53.616285 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-0e435841-2a90-4af0-a437-b6907959e8f6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Getting quotas for user 47965dc7f5964bbfa4efff0822530965 and project ba3bab98d31d49098a8e7242d51be646. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:30:53.651267 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0e435841-2a90-4af0-a437-b6907959e8f6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.241225 Nov 02 07:30:53.652007 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 91/175] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 07:30:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:30:53.656870 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f8a69f0d-e931-4f9c-be76-74d16775c5ff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:53.657926 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f8a69f0d-e931-4f9c-be76-74d16775c5ff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:53.674976 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f8a69f0d-e931-4f9c-be76-74d16775c5ff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:53.675908 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f8a69f0d-e931-4f9c-be76-74d16775c5ff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:53.677013 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f8a69f0d-e931-4f9c-be76-74d16775c5ff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:53.678099 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f8a69f0d-e931-4f9c-be76-74d16775c5ff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:53.678946 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f8a69f0d-e931-4f9c-be76-74d16775c5ff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:53.679556 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f8a69f0d-e931-4f9c-be76-74d16775c5ff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:53.718012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-e6facd1b-7fd5-4564-89f5-f26fc1d1ffe9 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:53.727348 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e6facd1b-7fd5-4564-89f5-f26fc1d1ffe9 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1314 microversion: 2.1 time: 0.236144 Nov 02 07:30:53.727949 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 85/176] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:53 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:53.843249 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f8a69f0d-e931-4f9c-be76-74d16775c5ff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:53.852395 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f8a69f0d-e931-4f9c-be76-74d16775c5ff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.199087 Nov 02 07:30:53.853456 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 92/177] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:53 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:54.647577 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-99102772-f342-43f7-83ae-ddb982e525bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:54.648429 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-99102772-f342-43f7-83ae-ddb982e525bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:54.729035 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-99102772-f342-43f7-83ae-ddb982e525bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:54.729035 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-99102772-f342-43f7-83ae-ddb982e525bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:54.729428 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-99102772-f342-43f7-83ae-ddb982e525bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:54.731615 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-99102772-f342-43f7-83ae-ddb982e525bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:54.765139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-bef73b89-4058-451d-8de2-456e190b664b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:54.768939 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-99102772-f342-43f7-83ae-ddb982e525bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:54.771196 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-99102772-f342-43f7-83ae-ddb982e525bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:54.771631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-bef73b89-4058-451d-8de2-456e190b664b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:54.817055 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=5 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:54.844124 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bef73b89-4058-451d-8de2-456e190b664b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:54.846583 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bef73b89-4058-451d-8de2-456e190b664b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:54.850052 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bef73b89-4058-451d-8de2-456e190b664b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:54.853701 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bef73b89-4058-451d-8de2-456e190b664b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:54.860694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bef73b89-4058-451d-8de2-456e190b664b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:54.866264 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bef73b89-4058-451d-8de2-456e190b664b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:54.916092 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-99102772-f342-43f7-83ae-ddb982e525bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/ips" status: 200 len: 150 microversion: 2.20 time: 0.291460 Nov 02 07:30:54.935691 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 86/178] 10.222.0.18 () {60 vars in 1289 bytes} [Wed Nov 2 07:30:54 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/ips => generated 150 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:30:54.959597 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-778a4768-d622-43a5-b099-d6c00ec23531 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:54.964302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-778a4768-d622-43a5-b099-d6c00ec23531 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:54.981242 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=100 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:54.981916 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-778a4768-d622-43a5-b099-d6c00ec23531 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:54.982943 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-778a4768-d622-43a5-b099-d6c00ec23531 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:54.987882 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-778a4768-d622-43a5-b099-d6c00ec23531 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:54.990064 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-778a4768-d622-43a5-b099-d6c00ec23531 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:54.993212 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-778a4768-d622-43a5-b099-d6c00ec23531 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:54.994135 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-778a4768-d622-43a5-b099-d6c00ec23531 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:55.425668 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-bef73b89-4058-451d-8de2-456e190b664b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:55.435940 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-778a4768-d622-43a5-b099-d6c00ec23531 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:55.445177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-bef73b89-4058-451d-8de2-456e190b664b tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1314 microversion: 2.1 time: 0.697798 Nov 02 07:30:55.446637 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 93/179] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:54 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1314 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:55.455521 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-778a4768-d622-43a5-b099-d6c00ec23531 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1522 microversion: 2.1 time: 0.517766 Nov 02 07:30:55.458518 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 87/180] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:54 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1522 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:55.699048 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1235482910", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db626555-8790-4323-a9e4-7db2e2eaf177"}], "security_groups": [{"name": "tempest-securitygroup--1544349208"}], "key_name": "tempest-keypair-375419057", "user_data": "}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:30:55.822110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.network.neutron [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] validate_networks() for [('db626555-8790-4323-a9e4-7db2e2eaf177', None, None, None, None, None)] {{(pid=118991) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:30:56.213844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Flavor limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:30:56.214267 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Image limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:30:56.214761 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Flavor pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:30:56.215162 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Image pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:30:56.215563 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:30:56.224538 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:56.225013 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:56.225442 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:56.226157 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:56.226644 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:56.227069 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:56.245314 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Getting quotas for project ba3bab98d31d49098a8e7242d51be646. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:30:56.249774 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Getting quotas for user 47965dc7f5964bbfa4efff0822530965 and project ba3bab98d31d49098a8e7242d51be646. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:30:56.260639 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Going to run 1 instances... {{(pid=118991) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:30:56.262815 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:30:56.314443 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-79536af7-a3fa-445a-a8cb-33c9d3fa1d4d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.620023 Nov 02 07:30:56.315466 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 94/181] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:30:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 07:30:56.328426 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9aac0f89-35f9-4901-ac4a-a53a69f1a616 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:56.337437 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9aac0f89-35f9-4901-ac4a-a53a69f1a616 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:56.341208 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=52 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:56.403614 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9aac0f89-35f9-4901-ac4a-a53a69f1a616 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:56.411227 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9aac0f89-35f9-4901-ac4a-a53a69f1a616 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1241 microversion: 2.1 time: 0.087952 Nov 02 07:30:56.411791 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 88/182] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:56 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:30:56.477797 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-6f826569-87ef-495e-b70d-852b7bf15e64 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:56.478969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-6f826569-87ef-495e-b70d-852b7bf15e64 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:56.483522 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-707aaa2f-9877-4d91-a00d-eb713bb13419 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:56.484782 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-707aaa2f-9877-4d91-a00d-eb713bb13419 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:56.490147 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6f826569-87ef-495e-b70d-852b7bf15e64 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:56.491088 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6f826569-87ef-495e-b70d-852b7bf15e64 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:56.492034 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6f826569-87ef-495e-b70d-852b7bf15e64 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:56.492494 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-707aaa2f-9877-4d91-a00d-eb713bb13419 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:56.493274 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-707aaa2f-9877-4d91-a00d-eb713bb13419 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:56.494111 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6f826569-87ef-495e-b70d-852b7bf15e64 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:56.494281 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-707aaa2f-9877-4d91-a00d-eb713bb13419 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:56.495275 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6f826569-87ef-495e-b70d-852b7bf15e64 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:56.495450 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-707aaa2f-9877-4d91-a00d-eb713bb13419 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:56.496706 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6f826569-87ef-495e-b70d-852b7bf15e64 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:56.497474 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-707aaa2f-9877-4d91-a00d-eb713bb13419 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:56.503739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-707aaa2f-9877-4d91-a00d-eb713bb13419 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:56.899932 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-707aaa2f-9877-4d91-a00d-eb713bb13419 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:56.912419 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-6f826569-87ef-495e-b70d-852b7bf15e64 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:56.921322 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-707aaa2f-9877-4d91-a00d-eb713bb13419 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1502 microversion: 2.1 time: 0.443221 Nov 02 07:30:56.924947 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-6f826569-87ef-495e-b70d-852b7bf15e64 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1314 microversion: 2.1 time: 0.454372 Nov 02 07:30:56.925481 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 89/183] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:56 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1502 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:30:56.927382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 95/184] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:56 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:56.948039 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-254c10de-4a9c-4194-adde-e72676ac41d7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:56.949038 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-254c10de-4a9c-4194-adde-e72676ac41d7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:56.956099 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-254c10de-4a9c-4194-adde-e72676ac41d7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:56.956652 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-254c10de-4a9c-4194-adde-e72676ac41d7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:56.957080 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-254c10de-4a9c-4194-adde-e72676ac41d7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:56.958117 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-254c10de-4a9c-4194-adde-e72676ac41d7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:56.958689 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-254c10de-4a9c-4194-adde-e72676ac41d7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:56.959382 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-254c10de-4a9c-4194-adde-e72676ac41d7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:57.102017 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-254c10de-4a9c-4194-adde-e72676ac41d7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:57.111444 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-254c10de-4a9c-4194-adde-e72676ac41d7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1516 microversion: 2.1 time: 0.170726 Nov 02 07:30:57.112016 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 90/185] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:56 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:57.437054 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-bddb085f-2ea5-41c1-b124-956a333cf274 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:57.438984 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-bddb085f-2ea5-41c1-b124-956a333cf274 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:57.451243 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bddb085f-2ea5-41c1-b124-956a333cf274 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:57.451730 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bddb085f-2ea5-41c1-b124-956a333cf274 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:57.452162 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bddb085f-2ea5-41c1-b124-956a333cf274 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:57.452858 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bddb085f-2ea5-41c1-b124-956a333cf274 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:57.453303 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bddb085f-2ea5-41c1-b124-956a333cf274 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:57.453716 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bddb085f-2ea5-41c1-b124-956a333cf274 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:57.520283 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-bddb085f-2ea5-41c1-b124-956a333cf274 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:57.528232 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-bddb085f-2ea5-41c1-b124-956a333cf274 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1245 microversion: 2.1 time: 0.096534 Nov 02 07:30:57.528844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 96/186] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:57 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:57.952186 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2a9093ad-1954-48e0-be4c-8217ac196863 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:57.952788 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-2a9093ad-1954-48e0-be4c-8217ac196863 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:57.959185 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2a9093ad-1954-48e0-be4c-8217ac196863 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:57.959658 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2a9093ad-1954-48e0-be4c-8217ac196863 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:57.960082 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2a9093ad-1954-48e0-be4c-8217ac196863 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:57.960755 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2a9093ad-1954-48e0-be4c-8217ac196863 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:57.961196 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2a9093ad-1954-48e0-be4c-8217ac196863 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:57.961642 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2a9093ad-1954-48e0-be4c-8217ac196863 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:58.097653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2a9093ad-1954-48e0-be4c-8217ac196863 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:58.105371 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-2a9093ad-1954-48e0-be4c-8217ac196863 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1314 microversion: 2.1 time: 0.157685 Nov 02 07:30:58.105960 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 91/187] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:57 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:58.552535 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5829a541-09dc-4646-83be-6088fe148f9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:58.554026 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-5829a541-09dc-4646-83be-6088fe148f9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:58.561377 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5829a541-09dc-4646-83be-6088fe148f9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:58.561950 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5829a541-09dc-4646-83be-6088fe148f9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:58.562353 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5829a541-09dc-4646-83be-6088fe148f9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:58.563133 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5829a541-09dc-4646-83be-6088fe148f9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:58.563588 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5829a541-09dc-4646-83be-6088fe148f9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:58.564116 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5829a541-09dc-4646-83be-6088fe148f9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:58.631396 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-5829a541-09dc-4646-83be-6088fe148f9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:58.657976 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-5829a541-09dc-4646-83be-6088fe148f9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1245 microversion: 2.1 time: 0.109536 Nov 02 07:30:58.658602 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 97/188] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:58 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1245 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:30:59.129597 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1d949b27-baaa-452f-ab27-778303b2b05c tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:59.130206 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1d949b27-baaa-452f-ab27-778303b2b05c tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:59.137093 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1d949b27-baaa-452f-ab27-778303b2b05c tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:59.137635 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1d949b27-baaa-452f-ab27-778303b2b05c tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:59.138347 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1d949b27-baaa-452f-ab27-778303b2b05c tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:59.139132 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1d949b27-baaa-452f-ab27-778303b2b05c tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:59.139593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1d949b27-baaa-452f-ab27-778303b2b05c tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:59.140156 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1d949b27-baaa-452f-ab27-778303b2b05c tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:59.292884 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1d949b27-baaa-452f-ab27-778303b2b05c tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:59.305597 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-1d949b27-baaa-452f-ab27-778303b2b05c tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1464 microversion: 2.1 time: 0.179754 Nov 02 07:30:59.306509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 92/189] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:59 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1464 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:59.414826 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ce5f0617-81c1-447f-bd14-087c51bdbfe1 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:59.415306 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-ce5f0617-81c1-447f-bd14-087c51bdbfe1 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:59.426202 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ce5f0617-81c1-447f-bd14-087c51bdbfe1 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:59.426881 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ce5f0617-81c1-447f-bd14-087c51bdbfe1 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:59.427948 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ce5f0617-81c1-447f-bd14-087c51bdbfe1 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:59.428734 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ce5f0617-81c1-447f-bd14-087c51bdbfe1 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:59.429181 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ce5f0617-81c1-447f-bd14-087c51bdbfe1 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:59.429637 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ce5f0617-81c1-447f-bd14-087c51bdbfe1 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:59.586312 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-bde06962-d5d2-4b00-8d76-3e27fe1f61db tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:30:59.589055 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-bde06962-d5d2-4b00-8d76-3e27fe1f61db tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:59.598470 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bde06962-d5d2-4b00-8d76-3e27fe1f61db tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:59.599098 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bde06962-d5d2-4b00-8d76-3e27fe1f61db tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:59.599609 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bde06962-d5d2-4b00-8d76-3e27fe1f61db tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:59.600512 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bde06962-d5d2-4b00-8d76-3e27fe1f61db tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:59.601057 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bde06962-d5d2-4b00-8d76-3e27fe1f61db tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:59.601675 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bde06962-d5d2-4b00-8d76-3e27fe1f61db tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:59.628669 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-bde06962-d5d2-4b00-8d76-3e27fe1f61db tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lazy-loading 'flavor' on Instance uuid 983e9075-27cf-4c74-bf6b-ff9fe8a68018 {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:30:59.631750 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-ce5f0617-81c1-447f-bd14-087c51bdbfe1 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Going to try to terminate instance {{(pid=118991) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:30:59.657632 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=100 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:30:59.768433 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ce5f0617-81c1-447f-bd14-087c51bdbfe1 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 204 len: 0 microversion: 2.1 time: 0.357072 Nov 02 07:30:59.769499 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 98/190] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:30:59 2022] DELETE /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:30:59.775360 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f5e018bc-8b01-46e7-a1e6-1c1f3461cddf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:59.776511 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f5e018bc-8b01-46e7-a1e6-1c1f3461cddf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:59.783831 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f5e018bc-8b01-46e7-a1e6-1c1f3461cddf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:59.784318 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f5e018bc-8b01-46e7-a1e6-1c1f3461cddf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:59.784988 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f5e018bc-8b01-46e7-a1e6-1c1f3461cddf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:59.785838 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f5e018bc-8b01-46e7-a1e6-1c1f3461cddf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:59.786293 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f5e018bc-8b01-46e7-a1e6-1c1f3461cddf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:59.786742 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f5e018bc-8b01-46e7-a1e6-1c1f3461cddf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:59.791587 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-bde06962-d5d2-4b00-8d76-3e27fe1f61db tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "POST /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018/action" status: 200 len: 32 microversion: 2.1 time: 0.210171 Nov 02 07:30:59.792272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 93/191] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 07:30:59 2022] POST /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 07:30:59.797399 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c653660c-280d-4405-9c42-a99cda94d850 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:59.798298 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c653660c-280d-4405-9c42-a99cda94d850 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:59.804896 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c653660c-280d-4405-9c42-a99cda94d850 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:59.805436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c653660c-280d-4405-9c42-a99cda94d850 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:59.805936 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c653660c-280d-4405-9c42-a99cda94d850 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:59.806701 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c653660c-280d-4405-9c42-a99cda94d850 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:59.807144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c653660c-280d-4405-9c42-a99cda94d850 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:59.807555 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c653660c-280d-4405-9c42-a99cda94d850 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:59.856294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f5e018bc-8b01-46e7-a1e6-1c1f3461cddf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:30:59.864082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f5e018bc-8b01-46e7-a1e6-1c1f3461cddf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1293 microversion: 2.1 time: 0.093021 Nov 02 07:30:59.864657 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 99/192] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:59 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:30:59.869350 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8c0318a7-4ae1-4ff8-b07b-00d71c8489e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:30:59.870132 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8c0318a7-4ae1-4ff8-b07b-00d71c8489e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:30:59.884978 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8c0318a7-4ae1-4ff8-b07b-00d71c8489e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:59.885599 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8c0318a7-4ae1-4ff8-b07b-00d71c8489e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:59.886195 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8c0318a7-4ae1-4ff8-b07b-00d71c8489e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:30:59.886987 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8c0318a7-4ae1-4ff8-b07b-00d71c8489e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:30:59.887504 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8c0318a7-4ae1-4ff8-b07b-00d71c8489e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:30:59.887983 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8c0318a7-4ae1-4ff8-b07b-00d71c8489e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:00.038002 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c653660c-280d-4405-9c42-a99cda94d850 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:00.047869 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c653660c-280d-4405-9c42-a99cda94d850 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1470 microversion: 2.1 time: 0.254377 Nov 02 07:31:00.055163 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 94/193] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:59 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1470 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:00.083359 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8c0318a7-4ae1-4ff8-b07b-00d71c8489e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:00.095373 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8c0318a7-4ae1-4ff8-b07b-00d71c8489e8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.229700 Nov 02 07:31:00.096123 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 100/194] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:30:59 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:00.470576 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f31272fb-4330-4742-b4b4-2aa5d4477b82 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:00.471166 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f31272fb-4330-4742-b4b4-2aa5d4477b82 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:00.477581 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f31272fb-4330-4742-b4b4-2aa5d4477b82 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:00.478062 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f31272fb-4330-4742-b4b4-2aa5d4477b82 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:00.478531 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f31272fb-4330-4742-b4b4-2aa5d4477b82 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:00.479213 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f31272fb-4330-4742-b4b4-2aa5d4477b82 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:00.479654 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f31272fb-4330-4742-b4b4-2aa5d4477b82 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:00.480070 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f31272fb-4330-4742-b4b4-2aa5d4477b82 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:00.506039 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-f31272fb-4330-4742-b4b4-2aa5d4477b82 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lazy-loading 'flavor' on Instance uuid cae04f42-6d0d-42e5-ae5f-8022b6f546df {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:31:00.887969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-93310f72-524b-473e-b5ce-ad532ad6f406 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:00.888840 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-93310f72-524b-473e-b5ce-ad532ad6f406 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:00.909426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-93310f72-524b-473e-b5ce-ad532ad6f406 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:00.909943 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-93310f72-524b-473e-b5ce-ad532ad6f406 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:00.910684 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-93310f72-524b-473e-b5ce-ad532ad6f406 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:00.911399 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-93310f72-524b-473e-b5ce-ad532ad6f406 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:00.912057 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-93310f72-524b-473e-b5ce-ad532ad6f406 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:00.913170 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-93310f72-524b-473e-b5ce-ad532ad6f406 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:00.940100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f31272fb-4330-4742-b4b4-2aa5d4477b82 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "POST /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/action" status: 202 len: 0 microversion: 2.20 time: 0.473868 Nov 02 07:31:00.940993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 95/195] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 07:31:00 2022] POST /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:31:00.950026 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0ff229b3-2760-49c4-823c-e1a26499d059 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:00.951694 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-0ff229b3-2760-49c4-823c-e1a26499d059 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:00.960186 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0ff229b3-2760-49c4-823c-e1a26499d059 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:00.960883 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0ff229b3-2760-49c4-823c-e1a26499d059 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:00.961469 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0ff229b3-2760-49c4-823c-e1a26499d059 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:00.962500 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0ff229b3-2760-49c4-823c-e1a26499d059 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:00.963022 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0ff229b3-2760-49c4-823c-e1a26499d059 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:00.963513 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0ff229b3-2760-49c4-823c-e1a26499d059 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:01.014977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-93310f72-524b-473e-b5ce-ad532ad6f406 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:01.024467 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-93310f72-524b-473e-b5ce-ad532ad6f406 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1293 microversion: 2.1 time: 0.140363 Nov 02 07:31:01.037103 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 101/196] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:00 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1293 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:01.088386 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0df578c8-7db6-4424-a33e-d6220198fb33 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:01.089600 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-0df578c8-7db6-4424-a33e-d6220198fb33 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:01.099372 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0df578c8-7db6-4424-a33e-d6220198fb33 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:01.103222 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0df578c8-7db6-4424-a33e-d6220198fb33 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:01.103771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0df578c8-7db6-4424-a33e-d6220198fb33 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:01.104830 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0df578c8-7db6-4424-a33e-d6220198fb33 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:01.105840 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0df578c8-7db6-4424-a33e-d6220198fb33 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:01.106573 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0df578c8-7db6-4424-a33e-d6220198fb33 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:01.159883 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-0ff229b3-2760-49c4-823c-e1a26499d059 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:01.169161 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-0ff229b3-2760-49c4-823c-e1a26499d059 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:01.172661 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-0ff229b3-2760-49c4-823c-e1a26499d059 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:01.174158 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-0ff229b3-2760-49c4-823c-e1a26499d059 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1722 microversion: 2.20 time: 0.228499 Nov 02 07:31:01.174919 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 96/197] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:00 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:01.199912 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6553aee2-b688-4d00-9e05-94e28c337d9d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:01.200522 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-6553aee2-b688-4d00-9e05-94e28c337d9d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:01.208533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6553aee2-b688-4d00-9e05-94e28c337d9d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:01.209455 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6553aee2-b688-4d00-9e05-94e28c337d9d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:01.210022 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6553aee2-b688-4d00-9e05-94e28c337d9d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:01.210909 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6553aee2-b688-4d00-9e05-94e28c337d9d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:01.211363 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6553aee2-b688-4d00-9e05-94e28c337d9d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:01.211877 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6553aee2-b688-4d00-9e05-94e28c337d9d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:01.334088 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0df578c8-7db6-4424-a33e-d6220198fb33 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:01.346506 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0df578c8-7db6-4424-a33e-d6220198fb33 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1470 microversion: 2.1 time: 0.269824 Nov 02 07:31:01.347284 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 102/198] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:01 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1470 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:01.400939 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-6553aee2-b688-4d00-9e05-94e28c337d9d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:01.409375 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-6553aee2-b688-4d00-9e05-94e28c337d9d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.220395 Nov 02 07:31:01.409961 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 97/199] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:01 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:02.047649 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c8407176-c40a-43da-8f55-d7d54b2cb600 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:02.048335 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c8407176-c40a-43da-8f55-d7d54b2cb600 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:02.088863 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c8407176-c40a-43da-8f55-d7d54b2cb600 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:02.097059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c8407176-c40a-43da-8f55-d7d54b2cb600 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:02.100940 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c8407176-c40a-43da-8f55-d7d54b2cb600 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:02.103694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c8407176-c40a-43da-8f55-d7d54b2cb600 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:02.106146 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c8407176-c40a-43da-8f55-d7d54b2cb600 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:02.107584 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c8407176-c40a-43da-8f55-d7d54b2cb600 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:02.214131 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-73ea3aa7-3fc1-4b3f-9082-dd28586a64d7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:02.214912 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-73ea3aa7-3fc1-4b3f-9082-dd28586a64d7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:02.242929 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-73ea3aa7-3fc1-4b3f-9082-dd28586a64d7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:02.244514 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-73ea3aa7-3fc1-4b3f-9082-dd28586a64d7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:02.246887 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-73ea3aa7-3fc1-4b3f-9082-dd28586a64d7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:02.249607 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-73ea3aa7-3fc1-4b3f-9082-dd28586a64d7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:02.250432 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-73ea3aa7-3fc1-4b3f-9082-dd28586a64d7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:02.251067 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-73ea3aa7-3fc1-4b3f-9082-dd28586a64d7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:02.307208 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c8407176-c40a-43da-8f55-d7d54b2cb600 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:02.323494 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c8407176-c40a-43da-8f55-d7d54b2cb600 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1299 microversion: 2.1 time: 0.280022 Nov 02 07:31:02.324346 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 103/200] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:02 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1299 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:02.373472 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-1159b62d-00a9-4419-b7cf-077f7c63e7ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:02.374850 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-1159b62d-00a9-4419-b7cf-077f7c63e7ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:02.390312 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1159b62d-00a9-4419-b7cf-077f7c63e7ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:02.391147 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1159b62d-00a9-4419-b7cf-077f7c63e7ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:02.391799 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1159b62d-00a9-4419-b7cf-077f7c63e7ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:02.392720 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1159b62d-00a9-4419-b7cf-077f7c63e7ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:02.394131 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1159b62d-00a9-4419-b7cf-077f7c63e7ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:02.395310 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1159b62d-00a9-4419-b7cf-077f7c63e7ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:02.778218 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-73ea3aa7-3fc1-4b3f-9082-dd28586a64d7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:02.788545 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-73ea3aa7-3fc1-4b3f-9082-dd28586a64d7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:02.790054 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-73ea3aa7-3fc1-4b3f-9082-dd28586a64d7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:02.791431 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-73ea3aa7-3fc1-4b3f-9082-dd28586a64d7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1722 microversion: 2.20 time: 0.593087 Nov 02 07:31:02.794048 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 98/201] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:02 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1722 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:31:02.799560 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f269778f-e7e5-4c16-81b2-5a7934c53f76 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:02.800348 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f269778f-e7e5-4c16-81b2-5a7934c53f76 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:02.816995 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f269778f-e7e5-4c16-81b2-5a7934c53f76 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:02.821159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f269778f-e7e5-4c16-81b2-5a7934c53f76 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:02.823571 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f269778f-e7e5-4c16-81b2-5a7934c53f76 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:02.824539 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f269778f-e7e5-4c16-81b2-5a7934c53f76 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:02.827207 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f269778f-e7e5-4c16-81b2-5a7934c53f76 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:02.828319 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f269778f-e7e5-4c16-81b2-5a7934c53f76 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:02.864172 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-1159b62d-00a9-4419-b7cf-077f7c63e7ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:02.885244 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-1159b62d-00a9-4419-b7cf-077f7c63e7ac tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1470 microversion: 2.1 time: 0.516784 Nov 02 07:31:02.889341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 104/202] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:02 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1470 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:03.349540 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-535273fd-70f3-455e-90e6-1dc01cf1407c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:03.353406 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-535273fd-70f3-455e-90e6-1dc01cf1407c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:03.363523 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-535273fd-70f3-455e-90e6-1dc01cf1407c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:03.364011 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-535273fd-70f3-455e-90e6-1dc01cf1407c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:03.364468 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-535273fd-70f3-455e-90e6-1dc01cf1407c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:03.365162 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-535273fd-70f3-455e-90e6-1dc01cf1407c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:03.365607 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-535273fd-70f3-455e-90e6-1dc01cf1407c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:03.366036 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-535273fd-70f3-455e-90e6-1dc01cf1407c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:03.533360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f269778f-e7e5-4c16-81b2-5a7934c53f76 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:03.543177 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f269778f-e7e5-4c16-81b2-5a7934c53f76 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.747241 Nov 02 07:31:03.543752 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 99/203] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:02 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:03.545482 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-535273fd-70f3-455e-90e6-1dc01cf1407c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:03.561051 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-535273fd-70f3-455e-90e6-1dc01cf1407c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1299 microversion: 2.1 time: 0.215748 Nov 02 07:31:03.561798 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 105/204] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:03 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1299 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:03.758003 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-f771d3c3-c4dc-4c74-8a22-5cd85629447a req-58446532-630f-4d3f-8fa4-c4c3db175b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2925e4e-7067-440f-ab0e-8fa62a7ffc56", "name": "network-vif-deleted", "tag": "0de2fcbc-76ab-4e2d-bb47-2d60ec17b2a5"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:03.807999 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-f771d3c3-c4dc-4c74-8a22-5cd85629447a req-58446532-630f-4d3f-8fa4-c4c3db175b76 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:03.816348 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-f771d3c3-c4dc-4c74-8a22-5cd85629447a req-58446532-630f-4d3f-8fa4-c4c3db175b76 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:03.817495 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-f771d3c3-c4dc-4c74-8a22-5cd85629447a req-58446532-630f-4d3f-8fa4-c4c3db175b76 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:03.819480 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-46d61132-f17a-4808-a4ed-4e9865bec540 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:03.820598 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-46d61132-f17a-4808-a4ed-4e9865bec540 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:03.830320 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-46d61132-f17a-4808-a4ed-4e9865bec540 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:03.831080 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-46d61132-f17a-4808-a4ed-4e9865bec540 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:03.832332 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-46d61132-f17a-4808-a4ed-4e9865bec540 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:03.833799 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-46d61132-f17a-4808-a4ed-4e9865bec540 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:03.834751 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-46d61132-f17a-4808-a4ed-4e9865bec540 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:03.835405 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-46d61132-f17a-4808-a4ed-4e9865bec540 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:03.836290 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-f771d3c3-c4dc-4c74-8a22-5cd85629447a req-58446532-630f-4d3f-8fa4-c4c3db175b76 service nova] Creating event network-vif-deleted:0de2fcbc-76ab-4e2d-bb47-2d60ec17b2a5 for instance e2925e4e-7067-440f-ab0e-8fa62a7ffc56 on hv-cinder-80473 Nov 02 07:31:03.858871 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-f771d3c3-c4dc-4c74-8a22-5cd85629447a req-58446532-630f-4d3f-8fa4-c4c3db175b76 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108374 Nov 02 07:31:03.859785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 100/205] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:31:03.910002 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3d95edea-072a-4396-a7ec-1e4443212a61 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:03.910755 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3d95edea-072a-4396-a7ec-1e4443212a61 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:03.917560 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d95edea-072a-4396-a7ec-1e4443212a61 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:03.918047 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d95edea-072a-4396-a7ec-1e4443212a61 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:03.918506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d95edea-072a-4396-a7ec-1e4443212a61 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:03.919346 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d95edea-072a-4396-a7ec-1e4443212a61 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:03.920963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d95edea-072a-4396-a7ec-1e4443212a61 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:03.921819 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d95edea-072a-4396-a7ec-1e4443212a61 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:04.034693 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3d95edea-072a-4396-a7ec-1e4443212a61 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:04.045751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3d95edea-072a-4396-a7ec-1e4443212a61 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1299 microversion: 2.1 time: 0.139108 Nov 02 07:31:04.046571 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 101/206] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:03 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1299 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:04.153353 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-46d61132-f17a-4808-a4ed-4e9865bec540 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:04.164631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-46d61132-f17a-4808-a4ed-4e9865bec540 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:04.166798 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-46d61132-f17a-4808-a4ed-4e9865bec540 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:04.169112 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-46d61132-f17a-4808-a4ed-4e9865bec540 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1722 microversion: 2.20 time: 0.353806 Nov 02 07:31:04.183113 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 106/207] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:03 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1722 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:31:04.567951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d388207c-fbe5-4bd4-b795-e857c6aa8dd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:04.568548 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-d388207c-fbe5-4bd4-b795-e857c6aa8dd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:04.575535 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d388207c-fbe5-4bd4-b795-e857c6aa8dd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:04.576257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d388207c-fbe5-4bd4-b795-e857c6aa8dd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:04.576683 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d388207c-fbe5-4bd4-b795-e857c6aa8dd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:04.577375 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d388207c-fbe5-4bd4-b795-e857c6aa8dd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:04.577816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d388207c-fbe5-4bd4-b795-e857c6aa8dd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:04.578229 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d388207c-fbe5-4bd4-b795-e857c6aa8dd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:04.585584 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-3a4e55b9-232b-47ec-ac17-af2e8ad0347a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:04.587237 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-3a4e55b9-232b-47ec-ac17-af2e8ad0347a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:04.597095 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3a4e55b9-232b-47ec-ac17-af2e8ad0347a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:04.597910 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3a4e55b9-232b-47ec-ac17-af2e8ad0347a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:04.598932 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3a4e55b9-232b-47ec-ac17-af2e8ad0347a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:04.600351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3a4e55b9-232b-47ec-ac17-af2e8ad0347a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:04.601509 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3a4e55b9-232b-47ec-ac17-af2e8ad0347a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:04.602219 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3a4e55b9-232b-47ec-ac17-af2e8ad0347a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:04.794201 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-d388207c-fbe5-4bd4-b795-e857c6aa8dd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:04.812158 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-d388207c-fbe5-4bd4-b795-e857c6aa8dd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.247895 Nov 02 07:31:04.812645 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 102/208] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:04 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:04.846331 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-3a4e55b9-232b-47ec-ac17-af2e8ad0347a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:04.855038 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-3a4e55b9-232b-47ec-ac17-af2e8ad0347a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1367 microversion: 2.1 time: 0.273852 Nov 02 07:31:04.855927 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 107/209] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:04 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:05.071669 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d2765da5-f012-4ae7-b2ac-fbbe0787269e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:05.072276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-d2765da5-f012-4ae7-b2ac-fbbe0787269e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:05.078985 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d2765da5-f012-4ae7-b2ac-fbbe0787269e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:05.079675 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d2765da5-f012-4ae7-b2ac-fbbe0787269e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:05.080102 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d2765da5-f012-4ae7-b2ac-fbbe0787269e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:05.081105 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d2765da5-f012-4ae7-b2ac-fbbe0787269e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:05.081557 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d2765da5-f012-4ae7-b2ac-fbbe0787269e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:05.081974 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d2765da5-f012-4ae7-b2ac-fbbe0787269e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:05.152521 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-d2765da5-f012-4ae7-b2ac-fbbe0787269e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:05.162732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-d2765da5-f012-4ae7-b2ac-fbbe0787269e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1299 microversion: 2.1 time: 0.094770 Nov 02 07:31:05.163894 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 103/210] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:05 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:05.195953 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ae3accee-4e1d-468a-8c67-27b138534079 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:05.196746 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-ae3accee-4e1d-468a-8c67-27b138534079 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:05.204994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ae3accee-4e1d-468a-8c67-27b138534079 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:05.204994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ae3accee-4e1d-468a-8c67-27b138534079 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:05.204994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ae3accee-4e1d-468a-8c67-27b138534079 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:05.205501 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ae3accee-4e1d-468a-8c67-27b138534079 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:05.206111 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ae3accee-4e1d-468a-8c67-27b138534079 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:05.206559 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ae3accee-4e1d-468a-8c67-27b138534079 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:05.365636 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ae3accee-4e1d-468a-8c67-27b138534079 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:05.368617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:05.378535 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ae3accee-4e1d-468a-8c67-27b138534079 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:05.380068 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ae3accee-4e1d-468a-8c67-27b138534079 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:05.381417 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ae3accee-4e1d-468a-8c67-27b138534079 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1722 microversion: 2.20 time: 0.190263 Nov 02 07:31:05.382643 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 108/211] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:05 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:05.835207 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9f7a6aad-79de-4929-85ac-f3b798e6e228 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:05.835815 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9f7a6aad-79de-4929-85ac-f3b798e6e228 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:05.843403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f7a6aad-79de-4929-85ac-f3b798e6e228 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:05.843888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f7a6aad-79de-4929-85ac-f3b798e6e228 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:05.844834 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f7a6aad-79de-4929-85ac-f3b798e6e228 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:05.845546 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f7a6aad-79de-4929-85ac-f3b798e6e228 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:05.846024 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f7a6aad-79de-4929-85ac-f3b798e6e228 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:05.846449 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f7a6aad-79de-4929-85ac-f3b798e6e228 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:05.882147 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-52faf058-1236-4a80-8142-2179918af706 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:05.883628 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-52faf058-1236-4a80-8142-2179918af706 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:05.893474 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-52faf058-1236-4a80-8142-2179918af706 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:05.894288 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-52faf058-1236-4a80-8142-2179918af706 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:05.894961 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-52faf058-1236-4a80-8142-2179918af706 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:05.895777 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-52faf058-1236-4a80-8142-2179918af706 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:05.896344 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-52faf058-1236-4a80-8142-2179918af706 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:05.896855 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-52faf058-1236-4a80-8142-2179918af706 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:06.038186 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9f7a6aad-79de-4929-85ac-f3b798e6e228 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:06.046707 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9f7a6aad-79de-4929-85ac-f3b798e6e228 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.215212 Nov 02 07:31:06.047276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 104/212] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:05 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:06.070659 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-52faf058-1236-4a80-8142-2179918af706 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:06.078470 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-52faf058-1236-4a80-8142-2179918af706 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1367 microversion: 2.1 time: 0.202670 Nov 02 07:31:06.079039 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 109/213] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:05 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:06.187731 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-23ad69da-7dcf-47b3-bcc4-f702d8671417 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:06.188331 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-23ad69da-7dcf-47b3-bcc4-f702d8671417 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:06.194480 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-23ad69da-7dcf-47b3-bcc4-f702d8671417 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:06.194955 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-23ad69da-7dcf-47b3-bcc4-f702d8671417 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:06.195379 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-23ad69da-7dcf-47b3-bcc4-f702d8671417 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:06.196057 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-23ad69da-7dcf-47b3-bcc4-f702d8671417 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:06.196505 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-23ad69da-7dcf-47b3-bcc4-f702d8671417 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:06.196920 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-23ad69da-7dcf-47b3-bcc4-f702d8671417 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:06.258382 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-23ad69da-7dcf-47b3-bcc4-f702d8671417 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:06.267639 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-23ad69da-7dcf-47b3-bcc4-f702d8671417 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1299 microversion: 2.1 time: 0.084101 Nov 02 07:31:06.268511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 105/214] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:06 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:06.408035 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-042947bb-f8b0-4478-b2ef-37c7d715422f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:06.408645 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-042947bb-f8b0-4478-b2ef-37c7d715422f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:06.410510 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:06.411213 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=10 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:06.417515 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-042947bb-f8b0-4478-b2ef-37c7d715422f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:06.417996 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-042947bb-f8b0-4478-b2ef-37c7d715422f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:06.418456 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-042947bb-f8b0-4478-b2ef-37c7d715422f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:06.419150 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-042947bb-f8b0-4478-b2ef-37c7d715422f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:06.419642 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-042947bb-f8b0-4478-b2ef-37c7d715422f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:06.420067 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-042947bb-f8b0-4478-b2ef-37c7d715422f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:06.589606 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-042947bb-f8b0-4478-b2ef-37c7d715422f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:06.600138 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-042947bb-f8b0-4478-b2ef-37c7d715422f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:06.602457 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-042947bb-f8b0-4478-b2ef-37c7d715422f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:06.603835 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-042947bb-f8b0-4478-b2ef-37c7d715422f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1722 microversion: 2.20 time: 0.200270 Nov 02 07:31:06.604461 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 110/215] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:06 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:07.070577 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1e44ef5f-e5e9-4bbe-9297-5d6e469288b9 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:07.071262 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1e44ef5f-e5e9-4bbe-9297-5d6e469288b9 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:07.074323 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:07.081273 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e44ef5f-e5e9-4bbe-9297-5d6e469288b9 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:07.081974 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e44ef5f-e5e9-4bbe-9297-5d6e469288b9 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:07.082967 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e44ef5f-e5e9-4bbe-9297-5d6e469288b9 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:07.084069 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e44ef5f-e5e9-4bbe-9297-5d6e469288b9 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:07.084811 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e44ef5f-e5e9-4bbe-9297-5d6e469288b9 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:07.085329 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e44ef5f-e5e9-4bbe-9297-5d6e469288b9 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:07.102923 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-98e9ed92-8bce-4c9b-afe8-af1c74a5f26b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:07.104265 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-98e9ed92-8bce-4c9b-afe8-af1c74a5f26b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:07.111741 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98e9ed92-8bce-4c9b-afe8-af1c74a5f26b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:07.112534 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98e9ed92-8bce-4c9b-afe8-af1c74a5f26b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:07.113177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98e9ed92-8bce-4c9b-afe8-af1c74a5f26b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:07.114126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98e9ed92-8bce-4c9b-afe8-af1c74a5f26b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:07.114737 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98e9ed92-8bce-4c9b-afe8-af1c74a5f26b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:07.115452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98e9ed92-8bce-4c9b-afe8-af1c74a5f26b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:07.391629 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1e44ef5f-e5e9-4bbe-9297-5d6e469288b9 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:07.396905 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-98e9ed92-8bce-4c9b-afe8-af1c74a5f26b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:07.399553 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-1e44ef5f-e5e9-4bbe-9297-5d6e469288b9 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.333575 Nov 02 07:31:07.400336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 106/216] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:07 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:07.418305 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-8a8ecc80-aaa5-49d5-b998-a77f1994ee1e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:07.419324 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-8a8ecc80-aaa5-49d5-b998-a77f1994ee1e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:07.421694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-98e9ed92-8bce-4c9b-afe8-af1c74a5f26b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1367 microversion: 2.1 time: 0.323198 Nov 02 07:31:07.422676 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 111/217] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:07 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:07.427208 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8a8ecc80-aaa5-49d5-b998-a77f1994ee1e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:07.427702 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8a8ecc80-aaa5-49d5-b998-a77f1994ee1e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:07.428143 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8a8ecc80-aaa5-49d5-b998-a77f1994ee1e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:07.428850 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8a8ecc80-aaa5-49d5-b998-a77f1994ee1e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:07.429529 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8a8ecc80-aaa5-49d5-b998-a77f1994ee1e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:07.430400 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8a8ecc80-aaa5-49d5-b998-a77f1994ee1e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:07.436743 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:07.471423 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8a8ecc80-aaa5-49d5-b998-a77f1994ee1e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:07.471922 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8a8ecc80-aaa5-49d5-b998-a77f1994ee1e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:07.472749 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8a8ecc80-aaa5-49d5-b998-a77f1994ee1e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:07.473252 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-8a8ecc80-aaa5-49d5-b998-a77f1994ee1e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lazy-loading 'fault' on Instance uuid e2925e4e-7067-440f-ab0e-8fa62a7ffc56 {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:31:07.537832 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-8a8ecc80-aaa5-49d5-b998-a77f1994ee1e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5d8789175745d398d0011f616785c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f746654bee4209b28de275a9ce5116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:07.549284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-8a8ecc80-aaa5-49d5-b998-a77f1994ee1e tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 200 len: 1304 microversion: 2.1 time: 0.147123 Nov 02 07:31:07.549927 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 107/218] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:07 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 1304 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:07.586120 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-e8b5dd7a-c21f-40a6-a7ec-58d71c20ee02 req-a18c96a6-3bf4-4746-b9e7-fbf3411030ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "793f8cfa-443a-4695-861e-6ba4c4e441ab", "tag": "01838f4f-9c12-4515-a5e5-af4ef1d4e33e"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:07.596515 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-e8b5dd7a-c21f-40a6-a7ec-58d71c20ee02 req-a18c96a6-3bf4-4746-b9e7-fbf3411030ec service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:07.596985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-e8b5dd7a-c21f-40a6-a7ec-58d71c20ee02 req-a18c96a6-3bf4-4746-b9e7-fbf3411030ec service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:07.597413 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-e8b5dd7a-c21f-40a6-a7ec-58d71c20ee02 req-a18c96a6-3bf4-4746-b9e7-fbf3411030ec service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:07.613738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-e8b5dd7a-c21f-40a6-a7ec-58d71c20ee02 req-a18c96a6-3bf4-4746-b9e7-fbf3411030ec service nova] Creating event network-changed:01838f4f-9c12-4515-a5e5-af4ef1d4e33e for instance 793f8cfa-443a-4695-861e-6ba4c4e441ab on hv-cinder-80473 Nov 02 07:31:07.622245 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-e8b5dd7a-c21f-40a6-a7ec-58d71c20ee02 req-a18c96a6-3bf4-4746-b9e7-fbf3411030ec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039389 Nov 02 07:31:07.624672 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 112/219] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:31:07.630880 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-091e5c61-5a2e-4a08-906d-2041b9bdd5e5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:07.631496 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-091e5c61-5a2e-4a08-906d-2041b9bdd5e5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:07.639833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-091e5c61-5a2e-4a08-906d-2041b9bdd5e5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:07.639833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-091e5c61-5a2e-4a08-906d-2041b9bdd5e5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:07.640371 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-091e5c61-5a2e-4a08-906d-2041b9bdd5e5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:07.641308 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-091e5c61-5a2e-4a08-906d-2041b9bdd5e5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:07.642582 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-091e5c61-5a2e-4a08-906d-2041b9bdd5e5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:07.644713 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-091e5c61-5a2e-4a08-906d-2041b9bdd5e5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:07.957001 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-091e5c61-5a2e-4a08-906d-2041b9bdd5e5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:07.970429 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-091e5c61-5a2e-4a08-906d-2041b9bdd5e5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:07.975467 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-091e5c61-5a2e-4a08-906d-2041b9bdd5e5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:07.977086 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-091e5c61-5a2e-4a08-906d-2041b9bdd5e5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1722 microversion: 2.20 time: 0.350429 Nov 02 07:31:07.978843 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 108/220] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:07 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1722 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:08.425019 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-82584b0e-6cd0-4935-b8d4-c44b2f756851 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:08.425616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-82584b0e-6cd0-4935-b8d4-c44b2f756851 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:08.432661 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-82584b0e-6cd0-4935-b8d4-c44b2f756851 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:08.433202 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-82584b0e-6cd0-4935-b8d4-c44b2f756851 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:08.433741 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-82584b0e-6cd0-4935-b8d4-c44b2f756851 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:08.434632 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-82584b0e-6cd0-4935-b8d4-c44b2f756851 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:08.435198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-82584b0e-6cd0-4935-b8d4-c44b2f756851 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:08.435671 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-82584b0e-6cd0-4935-b8d4-c44b2f756851 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:08.446905 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d31232da-c28d-4733-b1f9-ea13b2053450 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:08.447516 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-d31232da-c28d-4733-b1f9-ea13b2053450 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:08.454336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d31232da-c28d-4733-b1f9-ea13b2053450 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:08.454850 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d31232da-c28d-4733-b1f9-ea13b2053450 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:08.455285 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d31232da-c28d-4733-b1f9-ea13b2053450 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:08.455970 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d31232da-c28d-4733-b1f9-ea13b2053450 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:08.456582 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d31232da-c28d-4733-b1f9-ea13b2053450 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:08.457157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d31232da-c28d-4733-b1f9-ea13b2053450 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:08.739620 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-82584b0e-6cd0-4935-b8d4-c44b2f756851 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:08.748290 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-82584b0e-6cd0-4935-b8d4-c44b2f756851 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.327577 Nov 02 07:31:08.748866 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 113/221] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:08 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:08.753593 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ccf42c26-a603-4b4d-9909-3c5e943ac770 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:08.754194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-ccf42c26-a603-4b4d-9909-3c5e943ac770 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] [instance: e2925e4e-7067-440f-ab0e-8fa62a7ffc56] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:08.760046 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ccf42c26-a603-4b4d-9909-3c5e943ac770 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:08.760517 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ccf42c26-a603-4b4d-9909-3c5e943ac770 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:08.760939 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ccf42c26-a603-4b4d-9909-3c5e943ac770 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:08.761614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ccf42c26-a603-4b4d-9909-3c5e943ac770 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:08.762052 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ccf42c26-a603-4b4d-9909-3c5e943ac770 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:08.762504 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ccf42c26-a603-4b4d-9909-3c5e943ac770 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:08.768187 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-d31232da-c28d-4733-b1f9-ea13b2053450 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:08.776293 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-d31232da-c28d-4733-b1f9-ea13b2053450 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1367 microversion: 2.1 time: 0.333212 Nov 02 07:31:08.776874 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 109/222] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:08 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:08.778634 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-ccf42c26-a603-4b4d-9909-3c5e943ac770 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] HTTP exception thrown: Instance e2925e4e-7067-440f-ab0e-8fa62a7ffc56 could not be found. Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ccf42c26-a603-4b4d-9909-3c5e943ac770 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Request method failure captured: Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 HTTP/1.1 Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhyTmD7hv-yeOPiTR8IK5FH-iJeH8CUjymDf-EKtcewxtPAB_C-fSCMOB3_yMgm1LzGqn2SmFj6TZ9QPtNYuvZZvY-yBnqjmVuZ88agA6xL-9XFCymI7Gxhu8Cwe3ByfKpaBwPE9Sn6SzCrpX13mcS-ndCRgdSu8pwum-Y5iiyD4Bcc Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: 71f746654bee4209b28de275a9ce5116 Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-VolumesNegativeTest-392395577 Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:31:08.781016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:31:08.782547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_71f746654bee4209b28de275a9ce5116", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/71f746654bee4209b28de275a9ce5116"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/71f746654bee4209b28de275a9ce5116"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/71f746654bee4209b28de275a9ce5116"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:31:08.782547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-VolumesNegativeTest-392395577 Nov 02 07:31:08.782547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: 71f746654bee4209b28de275a9ce5116 Nov 02 07:31:08.782547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-VolumesNegativeTest-392395577 Nov 02 07:31:08.782547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-VolumesNegativeTest-392395577-project Nov 02 07:31:08.782547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:31:08.782547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:31:08.782547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: db5d8789175745d398d0011f616785c9 Nov 02 07:31:08.782547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-VolumesNegativeTest-392395577-project Nov 02 07:31:08.782547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:31:08.782547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance e2925e4e-7067-440f-ab0e-8fa62a7ffc56 could not be found. Nov 02 07:31:08.782547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': 'e2925e4e-7067-440f-ab0e-8fa62a7ffc56'} Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2925e4e-7067-440f-ab0e-8fa62a7ffc56 could not be found. Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:31:08.783449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2925e4e-7067-440f-ab0e-8fa62a7ffc56 could not be found. Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2925e4e-7067-440f-ab0e-8fa62a7ffc56 could not be found. Nov 02 07:31:08.784821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:31:08.785987 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ccf42c26-a603-4b4d-9909-3c5e943ac770 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] Returning 404 to user: Instance e2925e4e-7067-440f-ab0e-8fa62a7ffc56 could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:31:08.785987 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ccf42c26-a603-4b4d-9909-3c5e943ac770 tempest-VolumesNegativeTest-392395577 tempest-VolumesNegativeTest-392395577-project] 10.222.0.18 "GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56" status: 404 len: 111 microversion: 2.1 time: 0.032457 Nov 02 07:31:08.785987 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 114/223] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:08 2022] GET /compute/v2.1/servers/e2925e4e-7067-440f-ab0e-8fa62a7ffc56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:31:09.014435 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-51d5d97d-cea9-4e45-a788-f10bb86cbc31 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:09.015192 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-51d5d97d-cea9-4e45-a788-f10bb86cbc31 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:09.021780 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-51d5d97d-cea9-4e45-a788-f10bb86cbc31 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:09.022539 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-51d5d97d-cea9-4e45-a788-f10bb86cbc31 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:09.022975 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-51d5d97d-cea9-4e45-a788-f10bb86cbc31 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:09.023675 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-51d5d97d-cea9-4e45-a788-f10bb86cbc31 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:09.024133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-51d5d97d-cea9-4e45-a788-f10bb86cbc31 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:09.024556 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-51d5d97d-cea9-4e45-a788-f10bb86cbc31 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:09.175429 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-51d5d97d-cea9-4e45-a788-f10bb86cbc31 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:09.186867 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-51d5d97d-cea9-4e45-a788-f10bb86cbc31 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:09.188577 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-51d5d97d-cea9-4e45-a788-f10bb86cbc31 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:09.190019 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-51d5d97d-cea9-4e45-a788-f10bb86cbc31 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1722 microversion: 2.20 time: 0.179882 Nov 02 07:31:09.198960 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 110/224] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:09 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:09.775911 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a97e066e-d44e-4f74-a437-e4dcc08a0fef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:09.777071 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a97e066e-d44e-4f74-a437-e4dcc08a0fef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:09.784004 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a97e066e-d44e-4f74-a437-e4dcc08a0fef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:09.784479 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a97e066e-d44e-4f74-a437-e4dcc08a0fef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:09.785102 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a97e066e-d44e-4f74-a437-e4dcc08a0fef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:09.785793 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a97e066e-d44e-4f74-a437-e4dcc08a0fef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:09.786234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a97e066e-d44e-4f74-a437-e4dcc08a0fef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:09.786682 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a97e066e-d44e-4f74-a437-e4dcc08a0fef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:09.802136 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a234c78a-ca2b-46bd-83fd-d2ec4d4d4109 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:09.802780 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a234c78a-ca2b-46bd-83fd-d2ec4d4d4109 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:09.810657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a234c78a-ca2b-46bd-83fd-d2ec4d4d4109 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:09.812205 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a234c78a-ca2b-46bd-83fd-d2ec4d4d4109 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:09.812795 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a234c78a-ca2b-46bd-83fd-d2ec4d4d4109 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:09.813805 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a234c78a-ca2b-46bd-83fd-d2ec4d4d4109 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:09.814294 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a234c78a-ca2b-46bd-83fd-d2ec4d4d4109 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:09.815195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a234c78a-ca2b-46bd-83fd-d2ec4d4d4109 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:10.001982 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a97e066e-d44e-4f74-a437-e4dcc08a0fef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:10.009186 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a234c78a-ca2b-46bd-83fd-d2ec4d4d4109 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:10.010616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a97e066e-d44e-4f74-a437-e4dcc08a0fef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.238555 Nov 02 07:31:10.017529 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a234c78a-ca2b-46bd-83fd-d2ec4d4d4109 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1367 microversion: 2.1 time: 0.220507 Nov 02 07:31:10.018262 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 111/225] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:09 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:10.027177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 115/226] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:09 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:10.039386 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-760226030", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-823697442", "security_groups": [{"name": "tempest-secgroup-smoke-1042148425"}], "block_device_mapping_v2": [{"uuid": "f178cb83-3ae8-4fc1-ae6c-3a94daee8c2a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6809857-e0de-42f0-baa8-be80912a85f1"}]}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:10.162530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.network.neutron [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] validate_networks() for [('f6809857-e0de-42f0-baa8-be80912a85f1', None, None, None, None, None)] {{(pid=118992) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:31:10.219252 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-6679cb35-1778-4006-a7b6-f4c19a889c25 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:10.220180 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-6679cb35-1778-4006-a7b6-f4c19a889c25 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:10.234424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6679cb35-1778-4006-a7b6-f4c19a889c25 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:10.234916 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6679cb35-1778-4006-a7b6-f4c19a889c25 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:10.235347 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6679cb35-1778-4006-a7b6-f4c19a889c25 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:10.236041 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6679cb35-1778-4006-a7b6-f4c19a889c25 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:10.236487 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6679cb35-1778-4006-a7b6-f4c19a889c25 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:10.236908 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6679cb35-1778-4006-a7b6-f4c19a889c25 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:10.670773 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-6679cb35-1778-4006-a7b6-f4c19a889c25 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:10.680234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-6679cb35-1778-4006-a7b6-f4c19a889c25 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:10.681685 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-6679cb35-1778-4006-a7b6-f4c19a889c25 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:10.682904 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-6679cb35-1778-4006-a7b6-f4c19a889c25 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1722 microversion: 2.20 time: 0.469322 Nov 02 07:31:10.684273 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 116/227] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:10 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1722 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:31:10.953146 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Flavor limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:31:10.954255 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Image limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:31:10.954927 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Flavor pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:31:10.955349 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Image pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:31:10.955927 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:31:10.967656 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:10.968214 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:10.968659 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:10.969397 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:10.969849 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:10.970276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:10.989312 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Getting quotas for project 566514b413e24aaebe69c11ce2159ac9. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:31:10.993409 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Getting quotas for user fe26aea6bb9d4dcebf046da719b2c244 and project 566514b413e24aaebe69c11ce2159ac9. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:31:11.035061 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-55866769-1175-42f0-91ec-4a177fe8b917 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:11.036097 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-55866769-1175-42f0-91ec-4a177fe8b917 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:11.044062 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-55866769-1175-42f0-91ec-4a177fe8b917 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:11.045337 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-55866769-1175-42f0-91ec-4a177fe8b917 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:11.045996 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-55866769-1175-42f0-91ec-4a177fe8b917 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:11.046788 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-55866769-1175-42f0-91ec-4a177fe8b917 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:11.047420 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-55866769-1175-42f0-91ec-4a177fe8b917 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:11.048018 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-55866769-1175-42f0-91ec-4a177fe8b917 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:11.073091 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Going to run 1 instances... {{(pid=118992) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:31:11.077853 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f178cb83-3ae8-4fc1-ae6c-3a94daee8c2a',volume_size=None,volume_type=None)] {{(pid=118992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:31:11.199884 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-55866769-1175-42f0-91ec-4a177fe8b917 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:11.208509 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-55866769-1175-42f0-91ec-4a177fe8b917 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.177513 Nov 02 07:31:11.209081 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 117/228] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:11 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:11.213554 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-67f952b6-28ab-48fd-9ba5-96ddfaac7060 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:11.214336 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-67f952b6-28ab-48fd-9ba5-96ddfaac7060 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:11.222975 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-67f952b6-28ab-48fd-9ba5-96ddfaac7060 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:11.223470 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-67f952b6-28ab-48fd-9ba5-96ddfaac7060 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:11.224259 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-67f952b6-28ab-48fd-9ba5-96ddfaac7060 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:11.225117 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-67f952b6-28ab-48fd-9ba5-96ddfaac7060 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:11.225811 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-67f952b6-28ab-48fd-9ba5-96ddfaac7060 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:11.226554 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-67f952b6-28ab-48fd-9ba5-96ddfaac7060 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:11.299208 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-205bc705-7ef2-4c4c-a647-9d0e2d0e7f9f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.275037 Nov 02 07:31:11.309707 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 112/229] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:31:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 07:31:11.315395 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-56b4e615-645c-4db7-9d00-fe17cdd6801e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:11.316220 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-56b4e615-645c-4db7-9d00-fe17cdd6801e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:11.417059 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-56b4e615-645c-4db7-9d00-fe17cdd6801e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:11.425638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-56b4e615-645c-4db7-9d00-fe17cdd6801e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1093 microversion: 2.1 time: 0.114285 Nov 02 07:31:11.426241 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 113/230] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:11 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1093 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:11.459582 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-67f952b6-28ab-48fd-9ba5-96ddfaac7060 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:11.474773 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-67f952b6-28ab-48fd-9ba5-96ddfaac7060 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1367 microversion: 2.1 time: 0.263852 Nov 02 07:31:11.475765 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 118/231] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:11 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:11.708878 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-fd58dc18-3d2f-4573-a896-abf0084d80bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:11.709493 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-fd58dc18-3d2f-4573-a896-abf0084d80bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:11.716981 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd58dc18-3d2f-4573-a896-abf0084d80bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:11.717565 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd58dc18-3d2f-4573-a896-abf0084d80bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:11.717891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd58dc18-3d2f-4573-a896-abf0084d80bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:11.718621 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd58dc18-3d2f-4573-a896-abf0084d80bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:11.719074 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd58dc18-3d2f-4573-a896-abf0084d80bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:11.719498 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd58dc18-3d2f-4573-a896-abf0084d80bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:11.917224 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fd58dc18-3d2f-4573-a896-abf0084d80bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:11.929177 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fd58dc18-3d2f-4573-a896-abf0084d80bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:11.930884 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fd58dc18-3d2f-4573-a896-abf0084d80bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:11.933279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-fd58dc18-3d2f-4573-a896-abf0084d80bd tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1722 microversion: 2.20 time: 0.228204 Nov 02 07:31:11.947845 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 114/232] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:11 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:12.236346 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-1da97c22-56cb-4a29-8803-5f58fea1ef30 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:12.237837 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-1da97c22-56cb-4a29-8803-5f58fea1ef30 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:12.246840 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1da97c22-56cb-4a29-8803-5f58fea1ef30 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:12.247611 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1da97c22-56cb-4a29-8803-5f58fea1ef30 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:12.248996 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1da97c22-56cb-4a29-8803-5f58fea1ef30 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:12.249993 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1da97c22-56cb-4a29-8803-5f58fea1ef30 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:12.250746 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1da97c22-56cb-4a29-8803-5f58fea1ef30 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:12.251737 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1da97c22-56cb-4a29-8803-5f58fea1ef30 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:12.421939 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-1da97c22-56cb-4a29-8803-5f58fea1ef30 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:12.430540 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-1da97c22-56cb-4a29-8803-5f58fea1ef30 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.200919 Nov 02 07:31:12.431201 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 119/233] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:12 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:12.451804 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-bea93895-7206-4e7b-8a9b-8815e8274eeb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:12.453043 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-bea93895-7206-4e7b-8a9b-8815e8274eeb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:12.459331 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bea93895-7206-4e7b-8a9b-8815e8274eeb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:12.460033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bea93895-7206-4e7b-8a9b-8815e8274eeb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:12.460652 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bea93895-7206-4e7b-8a9b-8815e8274eeb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:12.461638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bea93895-7206-4e7b-8a9b-8815e8274eeb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:12.462327 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bea93895-7206-4e7b-8a9b-8815e8274eeb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:12.463023 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bea93895-7206-4e7b-8a9b-8815e8274eeb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:12.500968 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-1405f86f-b919-4b2c-97c6-cbe7a59912f9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:12.501517 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-1405f86f-b919-4b2c-97c6-cbe7a59912f9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:12.509835 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1405f86f-b919-4b2c-97c6-cbe7a59912f9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:12.510324 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1405f86f-b919-4b2c-97c6-cbe7a59912f9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:12.510795 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1405f86f-b919-4b2c-97c6-cbe7a59912f9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:12.511483 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1405f86f-b919-4b2c-97c6-cbe7a59912f9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:12.511937 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1405f86f-b919-4b2c-97c6-cbe7a59912f9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:12.512359 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1405f86f-b919-4b2c-97c6-cbe7a59912f9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:12.528522 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-bea93895-7206-4e7b-8a9b-8815e8274eeb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:12.541548 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-bea93895-7206-4e7b-8a9b-8815e8274eeb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1191 microversion: 2.1 time: 0.093804 Nov 02 07:31:12.542667 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 115/234] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:12 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:12.737330 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-1405f86f-b919-4b2c-97c6-cbe7a59912f9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:12.745664 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-1405f86f-b919-4b2c-97c6-cbe7a59912f9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1367 microversion: 2.1 time: 0.250488 Nov 02 07:31:12.746326 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 120/235] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:12 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:12.961095 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3bd691af-70a8-4670-91c7-2c7a187630c9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:12.961705 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3bd691af-70a8-4670-91c7-2c7a187630c9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:12.969669 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3bd691af-70a8-4670-91c7-2c7a187630c9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:12.970151 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3bd691af-70a8-4670-91c7-2c7a187630c9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:12.970611 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3bd691af-70a8-4670-91c7-2c7a187630c9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:12.971308 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3bd691af-70a8-4670-91c7-2c7a187630c9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:12.971757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3bd691af-70a8-4670-91c7-2c7a187630c9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:12.972175 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3bd691af-70a8-4670-91c7-2c7a187630c9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:13.203460 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3bd691af-70a8-4670-91c7-2c7a187630c9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:13.215791 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3bd691af-70a8-4670-91c7-2c7a187630c9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:13.217792 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3bd691af-70a8-4670-91c7-2c7a187630c9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:13.219046 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3bd691af-70a8-4670-91c7-2c7a187630c9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1722 microversion: 2.20 time: 0.261813 Nov 02 07:31:13.236059 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 116/236] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:12 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:13.455538 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-4fe95045-a59a-4b86-9d27-f439b647a7d2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:13.456148 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-4fe95045-a59a-4b86-9d27-f439b647a7d2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:13.465313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4fe95045-a59a-4b86-9d27-f439b647a7d2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:13.465796 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4fe95045-a59a-4b86-9d27-f439b647a7d2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:13.466244 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4fe95045-a59a-4b86-9d27-f439b647a7d2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:13.471714 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4fe95045-a59a-4b86-9d27-f439b647a7d2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:13.472536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4fe95045-a59a-4b86-9d27-f439b647a7d2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:13.474771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4fe95045-a59a-4b86-9d27-f439b647a7d2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:13.568510 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7b82558a-125f-42cb-a7bd-8a927624a634 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:13.569127 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-7b82558a-125f-42cb-a7bd-8a927624a634 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:13.579352 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b82558a-125f-42cb-a7bd-8a927624a634 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:13.580678 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b82558a-125f-42cb-a7bd-8a927624a634 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:13.581119 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b82558a-125f-42cb-a7bd-8a927624a634 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:13.582768 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b82558a-125f-42cb-a7bd-8a927624a634 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:13.583380 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b82558a-125f-42cb-a7bd-8a927624a634 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:13.583954 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b82558a-125f-42cb-a7bd-8a927624a634 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:13.687055 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-7b82558a-125f-42cb-a7bd-8a927624a634 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:13.698820 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-7b82558a-125f-42cb-a7bd-8a927624a634 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1209 microversion: 2.1 time: 0.134762 Nov 02 07:31:13.699940 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 117/237] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:13 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1209 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:13.749123 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-4fe95045-a59a-4b86-9d27-f439b647a7d2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:13.760849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-4fe95045-a59a-4b86-9d27-f439b647a7d2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.310062 Nov 02 07:31:13.762613 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 121/238] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:13 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:13.787542 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1de4c2e9-c7b8-4862-9150-8ec129dd9314 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:13.788342 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1de4c2e9-c7b8-4862-9150-8ec129dd9314 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:13.795459 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1de4c2e9-c7b8-4862-9150-8ec129dd9314 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:13.796111 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1de4c2e9-c7b8-4862-9150-8ec129dd9314 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:13.796854 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1de4c2e9-c7b8-4862-9150-8ec129dd9314 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:13.797692 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1de4c2e9-c7b8-4862-9150-8ec129dd9314 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:13.798280 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1de4c2e9-c7b8-4862-9150-8ec129dd9314 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:13.798868 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1de4c2e9-c7b8-4862-9150-8ec129dd9314 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:14.048187 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1de4c2e9-c7b8-4862-9150-8ec129dd9314 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:14.060407 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-1de4c2e9-c7b8-4862-9150-8ec129dd9314 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1367 microversion: 2.1 time: 0.280306 Nov 02 07:31:14.061947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 118/239] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:13 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:14.249362 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-e9fa617c-742b-41f9-8897-8a4b135ef891 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:14.249938 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-e9fa617c-742b-41f9-8897-8a4b135ef891 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:14.257130 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e9fa617c-742b-41f9-8897-8a4b135ef891 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:14.257624 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e9fa617c-742b-41f9-8897-8a4b135ef891 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:14.258111 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e9fa617c-742b-41f9-8897-8a4b135ef891 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:14.258774 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e9fa617c-742b-41f9-8897-8a4b135ef891 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:14.259506 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e9fa617c-742b-41f9-8897-8a4b135ef891 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:14.260276 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e9fa617c-742b-41f9-8897-8a4b135ef891 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:14.546678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e9fa617c-742b-41f9-8897-8a4b135ef891 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:14.557797 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e9fa617c-742b-41f9-8897-8a4b135ef891 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:14.559499 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e9fa617c-742b-41f9-8897-8a4b135ef891 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:14.562801 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e9fa617c-742b-41f9-8897-8a4b135ef891 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1722 microversion: 2.20 time: 0.318292 Nov 02 07:31:14.564053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 122/240] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:14 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:14.725604 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-68175216-c0d8-4d2c-92a3-980fae1b3eb8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:14.726915 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-68175216-c0d8-4d2c-92a3-980fae1b3eb8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:14.739585 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68175216-c0d8-4d2c-92a3-980fae1b3eb8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:14.740741 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68175216-c0d8-4d2c-92a3-980fae1b3eb8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:14.744924 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68175216-c0d8-4d2c-92a3-980fae1b3eb8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:14.747912 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68175216-c0d8-4d2c-92a3-980fae1b3eb8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:14.748758 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68175216-c0d8-4d2c-92a3-980fae1b3eb8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:14.750100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68175216-c0d8-4d2c-92a3-980fae1b3eb8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:14.794256 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ba5495cf-3e1a-42d1-9944-7aad62933d82 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:14.797448 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-ba5495cf-3e1a-42d1-9944-7aad62933d82 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:14.819354 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ba5495cf-3e1a-42d1-9944-7aad62933d82 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:14.820553 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ba5495cf-3e1a-42d1-9944-7aad62933d82 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:14.822053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ba5495cf-3e1a-42d1-9944-7aad62933d82 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:14.825164 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ba5495cf-3e1a-42d1-9944-7aad62933d82 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:14.825557 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ba5495cf-3e1a-42d1-9944-7aad62933d82 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:14.831812 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ba5495cf-3e1a-42d1-9944-7aad62933d82 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:15.268886 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-68175216-c0d8-4d2c-92a3-980fae1b3eb8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:15.276766 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-68175216-c0d8-4d2c-92a3-980fae1b3eb8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1265 microversion: 2.1 time: 0.556035 Nov 02 07:31:15.277346 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 119/241] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:14 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1265 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:15.283052 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-00597f27-3ab5-488e-82e1-451a4b795334 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:15.283803 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-00597f27-3ab5-488e-82e1-451a4b795334 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:15.290739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-00597f27-3ab5-488e-82e1-451a4b795334 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:15.291495 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-00597f27-3ab5-488e-82e1-451a4b795334 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:15.292084 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-00597f27-3ab5-488e-82e1-451a4b795334 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:15.293090 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-00597f27-3ab5-488e-82e1-451a4b795334 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:15.293700 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-00597f27-3ab5-488e-82e1-451a4b795334 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:15.295125 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-00597f27-3ab5-488e-82e1-451a4b795334 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:15.308379 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ba5495cf-3e1a-42d1-9944-7aad62933d82 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:15.319752 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ba5495cf-3e1a-42d1-9944-7aad62933d82 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.530248 Nov 02 07:31:15.321029 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 123/242] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:14 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:15.326424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-03704fe7-214c-487e-99f2-1b42d02a7b7e req-715112fc-28d1-41b3-b36b-c11fad89986a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "793f8cfa-443a-4695-861e-6ba4c4e441ab", "name": "network-vif-plugged", "status": "completed", "tag": "01838f4f-9c12-4515-a5e5-af4ef1d4e33e"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:15.347772 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-03704fe7-214c-487e-99f2-1b42d02a7b7e req-715112fc-28d1-41b3-b36b-c11fad89986a service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:15.349198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-03704fe7-214c-487e-99f2-1b42d02a7b7e req-715112fc-28d1-41b3-b36b-c11fad89986a service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:15.349843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-03704fe7-214c-487e-99f2-1b42d02a7b7e req-715112fc-28d1-41b3-b36b-c11fad89986a service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:15.364223 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-03704fe7-214c-487e-99f2-1b42d02a7b7e req-715112fc-28d1-41b3-b36b-c11fad89986a service nova] Creating event network-vif-plugged:01838f4f-9c12-4515-a5e5-af4ef1d4e33e for instance 793f8cfa-443a-4695-861e-6ba4c4e441ab on hv-cinder-80473 Nov 02 07:31:15.370627 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-03704fe7-214c-487e-99f2-1b42d02a7b7e req-715112fc-28d1-41b3-b36b-c11fad89986a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048187 Nov 02 07:31:15.371449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 124/243] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:31:15.591894 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-6a3d6030-739a-4afd-b118-0574ace3d014 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:15.592781 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-6a3d6030-739a-4afd-b118-0574ace3d014 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:15.599712 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6a3d6030-739a-4afd-b118-0574ace3d014 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:15.600242 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6a3d6030-739a-4afd-b118-0574ace3d014 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:15.600844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6a3d6030-739a-4afd-b118-0574ace3d014 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:15.601558 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6a3d6030-739a-4afd-b118-0574ace3d014 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:15.602011 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6a3d6030-739a-4afd-b118-0574ace3d014 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:15.602615 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6a3d6030-739a-4afd-b118-0574ace3d014 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:15.627961 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-00597f27-3ab5-488e-82e1-451a4b795334 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:15.652052 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-00597f27-3ab5-488e-82e1-451a4b795334 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1367 microversion: 2.1 time: 0.373477 Nov 02 07:31:15.652645 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 120/244] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:15 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:15.896242 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-6eb332a0-3213-4cde-88f1-dc614fe33bcd req-c5dbf0fc-1003-4320-8b7f-717a261b89dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c89d505-bb4e-469f-bcb9-c336439e865a", "tag": "417309a1-1746-4c69-89dd-ecf6b6199572"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:15.915325 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-6eb332a0-3213-4cde-88f1-dc614fe33bcd req-c5dbf0fc-1003-4320-8b7f-717a261b89dc service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:15.915950 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-6eb332a0-3213-4cde-88f1-dc614fe33bcd req-c5dbf0fc-1003-4320-8b7f-717a261b89dc service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:15.916499 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-6eb332a0-3213-4cde-88f1-dc614fe33bcd req-c5dbf0fc-1003-4320-8b7f-717a261b89dc service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:15.932043 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-6eb332a0-3213-4cde-88f1-dc614fe33bcd req-c5dbf0fc-1003-4320-8b7f-717a261b89dc service nova] Creating event network-changed:417309a1-1746-4c69-89dd-ecf6b6199572 for instance 4c89d505-bb4e-469f-bcb9-c336439e865a on hv-cinder-80473 Nov 02 07:31:15.940131 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-6eb332a0-3213-4cde-88f1-dc614fe33bcd req-c5dbf0fc-1003-4320-8b7f-717a261b89dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047876 Nov 02 07:31:15.941503 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 121/245] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:31:15.941623 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-6a3d6030-739a-4afd-b118-0574ace3d014 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:15.958248 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-6a3d6030-739a-4afd-b118-0574ace3d014 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:15.969408 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-6a3d6030-739a-4afd-b118-0574ace3d014 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:15.970650 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-6a3d6030-739a-4afd-b118-0574ace3d014 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1722 microversion: 2.20 time: 0.384226 Nov 02 07:31:15.971210 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 125/246] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:15 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1722 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:31:16.304967 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d71b3dde-3c49-43fc-b8c4-f88f2ff964b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:16.305717 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-d71b3dde-3c49-43fc-b8c4-f88f2ff964b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:16.313622 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d71b3dde-3c49-43fc-b8c4-f88f2ff964b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:16.326450 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d71b3dde-3c49-43fc-b8c4-f88f2ff964b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:16.331936 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d71b3dde-3c49-43fc-b8c4-f88f2ff964b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:16.333090 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d71b3dde-3c49-43fc-b8c4-f88f2ff964b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:16.333642 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d71b3dde-3c49-43fc-b8c4-f88f2ff964b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:16.334314 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d71b3dde-3c49-43fc-b8c4-f88f2ff964b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:16.349950 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d71be953-1b3b-40cd-8551-0c85fd6b619e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:16.350602 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-d71be953-1b3b-40cd-8551-0c85fd6b619e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:16.357941 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d71be953-1b3b-40cd-8551-0c85fd6b619e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:16.358686 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d71be953-1b3b-40cd-8551-0c85fd6b619e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:16.359366 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d71be953-1b3b-40cd-8551-0c85fd6b619e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:16.360365 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d71be953-1b3b-40cd-8551-0c85fd6b619e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:16.361008 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d71be953-1b3b-40cd-8551-0c85fd6b619e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:16.361620 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d71be953-1b3b-40cd-8551-0c85fd6b619e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:16.639465 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-d71b3dde-3c49-43fc-b8c4-f88f2ff964b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:16.648216 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-d71b3dde-3c49-43fc-b8c4-f88f2ff964b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1265 microversion: 2.1 time: 0.350193 Nov 02 07:31:16.659018 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 122/247] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:16 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1265 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:16.665479 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d71be953-1b3b-40cd-8551-0c85fd6b619e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:16.675996 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3f01e29f-86d1-435a-8fed-9ef49a8816a7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:16.676442 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d71be953-1b3b-40cd-8551-0c85fd6b619e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.330242 Nov 02 07:31:16.676717 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3f01e29f-86d1-435a-8fed-9ef49a8816a7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:16.677312 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 126/248] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:16 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:16.683494 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3f01e29f-86d1-435a-8fed-9ef49a8816a7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:16.683983 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3f01e29f-86d1-435a-8fed-9ef49a8816a7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:16.684417 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3f01e29f-86d1-435a-8fed-9ef49a8816a7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:16.685661 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3f01e29f-86d1-435a-8fed-9ef49a8816a7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:16.686949 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3f01e29f-86d1-435a-8fed-9ef49a8816a7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:16.688002 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3f01e29f-86d1-435a-8fed-9ef49a8816a7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:16.898132 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3f01e29f-86d1-435a-8fed-9ef49a8816a7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:16.907619 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3f01e29f-86d1-435a-8fed-9ef49a8816a7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1367 microversion: 2.1 time: 0.235887 Nov 02 07:31:16.908221 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 123/249] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:16 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:16.996880 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-e2a2a652-95cd-44bb-a328-9af4489062ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:16.997586 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-e2a2a652-95cd-44bb-a328-9af4489062ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:17.003925 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e2a2a652-95cd-44bb-a328-9af4489062ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:17.004607 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e2a2a652-95cd-44bb-a328-9af4489062ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:17.005188 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e2a2a652-95cd-44bb-a328-9af4489062ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:17.005994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e2a2a652-95cd-44bb-a328-9af4489062ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:17.006681 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e2a2a652-95cd-44bb-a328-9af4489062ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:17.007115 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e2a2a652-95cd-44bb-a328-9af4489062ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:17.023924 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=100 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:17.147629 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e2a2a652-95cd-44bb-a328-9af4489062ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:17.156778 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e2a2a652-95cd-44bb-a328-9af4489062ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:17.158214 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e2a2a652-95cd-44bb-a328-9af4489062ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:17.159407 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e2a2a652-95cd-44bb-a328-9af4489062ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1722 microversion: 2.20 time: 0.166820 Nov 02 07:31:17.159961 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 127/250] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:16 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:17.671286 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-1e8671a5-615e-4607-a105-266cd9cb6752 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:17.671905 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-1e8671a5-615e-4607-a105-266cd9cb6752 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:17.672755 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-898147392", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452", "networks": [{"uuid": "3fafd9c5-3180-43ff-9a2d-50cffbbda74e"}]}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:17.678143 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1e8671a5-615e-4607-a105-266cd9cb6752 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:17.678783 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1e8671a5-615e-4607-a105-266cd9cb6752 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:17.679286 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1e8671a5-615e-4607-a105-266cd9cb6752 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:17.680063 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1e8671a5-615e-4607-a105-266cd9cb6752 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:17.680588 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1e8671a5-615e-4607-a105-266cd9cb6752 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:17.681086 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1e8671a5-615e-4607-a105-266cd9cb6752 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:17.739419 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.network.neutron [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] validate_networks() for [('3fafd9c5-3180-43ff-9a2d-50cffbbda74e', None, None, None, None, None)] {{(pid=118992) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:31:18.019741 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-1e8671a5-615e-4607-a105-266cd9cb6752 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:18.028610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-1e8671a5-615e-4607-a105-266cd9cb6752 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1265 microversion: 2.1 time: 0.361122 Nov 02 07:31:18.029674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 128/251] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:17 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1265 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:18.034509 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c827597e-3900-4400-abda-a63b58d15790 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:18.035386 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c827597e-3900-4400-abda-a63b58d15790 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:18.041998 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c827597e-3900-4400-abda-a63b58d15790 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:18.042606 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c827597e-3900-4400-abda-a63b58d15790 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:18.043118 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c827597e-3900-4400-abda-a63b58d15790 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:18.043886 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c827597e-3900-4400-abda-a63b58d15790 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:18.044523 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c827597e-3900-4400-abda-a63b58d15790 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:18.045364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c827597e-3900-4400-abda-a63b58d15790 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:18.567799 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c827597e-3900-4400-abda-a63b58d15790 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:18.578752 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c827597e-3900-4400-abda-a63b58d15790 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.547595 Nov 02 07:31:18.580131 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 129/252] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:18 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:18.584890 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-6bd84386-1c37-4082-b9ab-aa8bdebbcf5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:18.585495 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-6bd84386-1c37-4082-b9ab-aa8bdebbcf5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:18.591962 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6bd84386-1c37-4082-b9ab-aa8bdebbcf5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:18.592612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6bd84386-1c37-4082-b9ab-aa8bdebbcf5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:18.593043 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6bd84386-1c37-4082-b9ab-aa8bdebbcf5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:18.593729 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6bd84386-1c37-4082-b9ab-aa8bdebbcf5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:18.594320 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6bd84386-1c37-4082-b9ab-aa8bdebbcf5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:18.594910 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6bd84386-1c37-4082-b9ab-aa8bdebbcf5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:18.710795 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Flavor limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:31:18.711244 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Image limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:31:18.711663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Flavor pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:31:18.712231 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Image pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:31:18.712637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:31:18.722171 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:18.722675 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:18.723299 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:18.724022 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:18.724475 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:18.724891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:18.741649 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Getting quotas for project 155356fb94b74eaba3a8465d1a1f21ff. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:31:18.743884 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:18.746782 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Getting quotas for user 0b55941561934c818a2b5eb2c9a19d22 and project 155356fb94b74eaba3a8465d1a1f21ff. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:31:18.760248 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Going to run 1 instances... {{(pid=118992) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:31:18.760803 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-6bd84386-1c37-4082-b9ab-aa8bdebbcf5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:18.762563 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:31:18.769326 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-6bd84386-1c37-4082-b9ab-aa8bdebbcf5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1556 microversion: 2.1 time: 0.188007 Nov 02 07:31:18.769996 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 130/253] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:18 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:18.774636 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ace39be2-f3b8-4150-9f43-bc1b27ae5cf1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:18.775431 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-ace39be2-f3b8-4150-9f43-bc1b27ae5cf1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:18.781169 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ace39be2-f3b8-4150-9f43-bc1b27ae5cf1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:18.781908 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ace39be2-f3b8-4150-9f43-bc1b27ae5cf1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:18.782412 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ace39be2-f3b8-4150-9f43-bc1b27ae5cf1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:18.783162 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ace39be2-f3b8-4150-9f43-bc1b27ae5cf1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:18.783675 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ace39be2-f3b8-4150-9f43-bc1b27ae5cf1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:18.784160 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ace39be2-f3b8-4150-9f43-bc1b27ae5cf1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:18.825376 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ed9e41c4-0fe1-4699-a674-a820a06a7063 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.157475 Nov 02 07:31:18.830406 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 124/254] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:31:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 07:31:18.831726 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-08256bed-88b0-425e-a4dc-8d9464a13ea0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:18.832189 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-08256bed-88b0-425e-a4dc-8d9464a13ea0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:18.839579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-08256bed-88b0-425e-a4dc-8d9464a13ea0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:18.840063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-08256bed-88b0-425e-a4dc-8d9464a13ea0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:18.840485 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-08256bed-88b0-425e-a4dc-8d9464a13ea0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:18.841186 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-08256bed-88b0-425e-a4dc-8d9464a13ea0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:18.841686 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-08256bed-88b0-425e-a4dc-8d9464a13ea0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:18.842076 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-08256bed-88b0-425e-a4dc-8d9464a13ea0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:18.950469 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-08256bed-88b0-425e-a4dc-8d9464a13ea0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122085 Nov 02 07:31:18.952649 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 125/255] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 07:31:18 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:31:18.963265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3bdfdb81-b046-4571-9880-a6ebca10d611 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:18.964024 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3bdfdb81-b046-4571-9880-a6ebca10d611 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:19.056136 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3bdfdb81-b046-4571-9880-a6ebca10d611 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:19.065026 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3bdfdb81-b046-4571-9880-a6ebca10d611 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1213 microversion: 2.1 time: 0.111179 Nov 02 07:31:19.065607 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 126/256] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:18 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1213 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:19.079477 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ace39be2-f3b8-4150-9f43-bc1b27ae5cf1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:19.081582 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-86e8d1b3-2cc7-4644-8fd0-2dbca1fea27c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:19.082561 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-86e8d1b3-2cc7-4644-8fd0-2dbca1fea27c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:19.093901 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ace39be2-f3b8-4150-9f43-bc1b27ae5cf1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:19.095783 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ace39be2-f3b8-4150-9f43-bc1b27ae5cf1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:19.098187 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ace39be2-f3b8-4150-9f43-bc1b27ae5cf1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1743 microversion: 2.20 time: 0.327038 Nov 02 07:31:19.099128 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 131/257] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:18 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1743 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:19.106536 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-86e8d1b3-2cc7-4644-8fd0-2dbca1fea27c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:19.106536 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-86e8d1b3-2cc7-4644-8fd0-2dbca1fea27c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:19.106536 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-86e8d1b3-2cc7-4644-8fd0-2dbca1fea27c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:19.106536 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-86e8d1b3-2cc7-4644-8fd0-2dbca1fea27c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:19.110038 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-86e8d1b3-2cc7-4644-8fd0-2dbca1fea27c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:19.110038 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-86e8d1b3-2cc7-4644-8fd0-2dbca1fea27c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:19.259096 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-86e8d1b3-2cc7-4644-8fd0-2dbca1fea27c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:19.264657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=100 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:19.272890 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-86e8d1b3-2cc7-4644-8fd0-2dbca1fea27c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1265 microversion: 2.1 time: 0.202037 Nov 02 07:31:19.273500 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 127/258] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:19 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:19.604621 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f6dd786f-5f65-48a8-bc78-232cd6b6732c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:19.605413 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f6dd786f-5f65-48a8-bc78-232cd6b6732c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:19.614921 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:19.617510 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6dd786f-5f65-48a8-bc78-232cd6b6732c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:19.618547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6dd786f-5f65-48a8-bc78-232cd6b6732c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:19.619269 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6dd786f-5f65-48a8-bc78-232cd6b6732c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:19.620323 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6dd786f-5f65-48a8-bc78-232cd6b6732c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:19.621765 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6dd786f-5f65-48a8-bc78-232cd6b6732c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:19.623047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6dd786f-5f65-48a8-bc78-232cd6b6732c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:19.769754 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f6dd786f-5f65-48a8-bc78-232cd6b6732c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:19.777440 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f6dd786f-5f65-48a8-bc78-232cd6b6732c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.177328 Nov 02 07:31:19.778004 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 132/259] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:19 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:20.094646 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-4a5cd0ef-704b-435a-a4b1-eacff2fe3fd7 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:20.094646 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-4a5cd0ef-704b-435a-a4b1-eacff2fe3fd7 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:20.105412 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4a5cd0ef-704b-435a-a4b1-eacff2fe3fd7 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:20.105893 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4a5cd0ef-704b-435a-a4b1-eacff2fe3fd7 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:20.106407 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4a5cd0ef-704b-435a-a4b1-eacff2fe3fd7 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:20.108256 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4a5cd0ef-704b-435a-a4b1-eacff2fe3fd7 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:20.111124 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4a5cd0ef-704b-435a-a4b1-eacff2fe3fd7 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:20.111471 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4a5cd0ef-704b-435a-a4b1-eacff2fe3fd7 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:20.129092 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f6ae79c3-5abf-4f37-9eb4-a8992f16d68b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:20.129937 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f6ae79c3-5abf-4f37-9eb4-a8992f16d68b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:20.138067 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6ae79c3-5abf-4f37-9eb4-a8992f16d68b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:20.139420 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6ae79c3-5abf-4f37-9eb4-a8992f16d68b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:20.140073 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6ae79c3-5abf-4f37-9eb4-a8992f16d68b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:20.141116 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6ae79c3-5abf-4f37-9eb4-a8992f16d68b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:20.142157 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6ae79c3-5abf-4f37-9eb4-a8992f16d68b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:20.143000 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6ae79c3-5abf-4f37-9eb4-a8992f16d68b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:20.211367 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-4a5cd0ef-704b-435a-a4b1-eacff2fe3fd7 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:20.222818 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-4a5cd0ef-704b-435a-a4b1-eacff2fe3fd7 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1265 microversion: 2.1 time: 0.137022 Nov 02 07:31:20.224035 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 128/260] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:20 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:20.295708 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f605b861-a125-43c4-ad35-02f886ad6433 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:20.296567 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f605b861-a125-43c4-ad35-02f886ad6433 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:20.302831 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f605b861-a125-43c4-ad35-02f886ad6433 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:20.303611 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f605b861-a125-43c4-ad35-02f886ad6433 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:20.304283 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f605b861-a125-43c4-ad35-02f886ad6433 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:20.305042 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f605b861-a125-43c4-ad35-02f886ad6433 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:20.305702 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f605b861-a125-43c4-ad35-02f886ad6433 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:20.306312 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f605b861-a125-43c4-ad35-02f886ad6433 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:20.331572 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f6ae79c3-5abf-4f37-9eb4-a8992f16d68b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:20.345999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f6ae79c3-5abf-4f37-9eb4-a8992f16d68b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:20.348085 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f6ae79c3-5abf-4f37-9eb4-a8992f16d68b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:20.349297 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f6ae79c3-5abf-4f37-9eb4-a8992f16d68b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1743 microversion: 2.20 time: 0.224280 Nov 02 07:31:20.349845 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 133/261] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:20 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1743 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:31:20.483583 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f605b861-a125-43c4-ad35-02f886ad6433 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:20.493902 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-d7695651-a8a1-4f65-a089-d2649a5a4e49 req-bdfe099c-a5f6-4db1-8cc9-6fb88322b2ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "793f8cfa-443a-4695-861e-6ba4c4e441ab", "tag": "01838f4f-9c12-4515-a5e5-af4ef1d4e33e"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:20.495621 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f605b861-a125-43c4-ad35-02f886ad6433 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1265 microversion: 2.1 time: 0.204240 Nov 02 07:31:20.496799 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 129/262] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:20 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:20.518038 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-d7695651-a8a1-4f65-a089-d2649a5a4e49 req-bdfe099c-a5f6-4db1-8cc9-6fb88322b2ab service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:20.519214 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-d7695651-a8a1-4f65-a089-d2649a5a4e49 req-bdfe099c-a5f6-4db1-8cc9-6fb88322b2ab service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:20.519816 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-d7695651-a8a1-4f65-a089-d2649a5a4e49 req-bdfe099c-a5f6-4db1-8cc9-6fb88322b2ab service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:20.533009 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-d7695651-a8a1-4f65-a089-d2649a5a4e49 req-bdfe099c-a5f6-4db1-8cc9-6fb88322b2ab service nova] Creating event network-changed:01838f4f-9c12-4515-a5e5-af4ef1d4e33e for instance 793f8cfa-443a-4695-861e-6ba4c4e441ab on hv-cinder-80473 Nov 02 07:31:20.539367 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-d7695651-a8a1-4f65-a089-d2649a5a4e49 req-bdfe099c-a5f6-4db1-8cc9-6fb88322b2ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049154 Nov 02 07:31:20.540173 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 134/263] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:31:20.801203 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c3ebc4d1-a50c-4ce0-ad50-70cf6f82b8bf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:20.801810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c3ebc4d1-a50c-4ce0-ad50-70cf6f82b8bf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:20.808069 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c3ebc4d1-a50c-4ce0-ad50-70cf6f82b8bf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:20.808616 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c3ebc4d1-a50c-4ce0-ad50-70cf6f82b8bf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:20.809100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c3ebc4d1-a50c-4ce0-ad50-70cf6f82b8bf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:20.809852 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c3ebc4d1-a50c-4ce0-ad50-70cf6f82b8bf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:20.810286 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c3ebc4d1-a50c-4ce0-ad50-70cf6f82b8bf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:20.810733 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c3ebc4d1-a50c-4ce0-ad50-70cf6f82b8bf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:20.945322 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c3ebc4d1-a50c-4ce0-ad50-70cf6f82b8bf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:20.955099 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c3ebc4d1-a50c-4ce0-ad50-70cf6f82b8bf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.157741 Nov 02 07:31:20.956004 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 130/264] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:20 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:21.248068 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c11e50e1-2ba4-4cb4-87cc-c7b9b639c8c3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:21.248767 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c11e50e1-2ba4-4cb4-87cc-c7b9b639c8c3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:21.255734 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c11e50e1-2ba4-4cb4-87cc-c7b9b639c8c3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:21.256208 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c11e50e1-2ba4-4cb4-87cc-c7b9b639c8c3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:21.256643 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c11e50e1-2ba4-4cb4-87cc-c7b9b639c8c3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:21.257333 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c11e50e1-2ba4-4cb4-87cc-c7b9b639c8c3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:21.258082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c11e50e1-2ba4-4cb4-87cc-c7b9b639c8c3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:21.258543 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c11e50e1-2ba4-4cb4-87cc-c7b9b639c8c3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:21.326952 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c11e50e1-2ba4-4cb4-87cc-c7b9b639c8c3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:21.335570 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c11e50e1-2ba4-4cb4-87cc-c7b9b639c8c3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1265 microversion: 2.1 time: 0.091719 Nov 02 07:31:21.336350 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 135/265] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:21 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:21.375630 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-14c93d11-9540-4ab6-adb7-44e64e03a683 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:21.376235 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-14c93d11-9540-4ab6-adb7-44e64e03a683 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:21.382774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-14c93d11-9540-4ab6-adb7-44e64e03a683 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:21.383258 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-14c93d11-9540-4ab6-adb7-44e64e03a683 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:21.383692 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-14c93d11-9540-4ab6-adb7-44e64e03a683 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:21.384382 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-14c93d11-9540-4ab6-adb7-44e64e03a683 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:21.384831 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-14c93d11-9540-4ab6-adb7-44e64e03a683 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:21.385251 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-14c93d11-9540-4ab6-adb7-44e64e03a683 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:21.520026 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-6cc8e00e-641e-45cb-9a29-e458b3a5905e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:21.520898 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-6cc8e00e-641e-45cb-9a29-e458b3a5905e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:21.527575 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6cc8e00e-641e-45cb-9a29-e458b3a5905e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:21.528313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6cc8e00e-641e-45cb-9a29-e458b3a5905e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:21.529538 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6cc8e00e-641e-45cb-9a29-e458b3a5905e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:21.532154 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6cc8e00e-641e-45cb-9a29-e458b3a5905e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:21.532838 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6cc8e00e-641e-45cb-9a29-e458b3a5905e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:21.533643 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6cc8e00e-641e-45cb-9a29-e458b3a5905e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:21.554089 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-14c93d11-9540-4ab6-adb7-44e64e03a683 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:21.563295 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-14c93d11-9540-4ab6-adb7-44e64e03a683 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:21.564866 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-14c93d11-9540-4ab6-adb7-44e64e03a683 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:21.566287 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-14c93d11-9540-4ab6-adb7-44e64e03a683 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1743 microversion: 2.20 time: 0.194685 Nov 02 07:31:21.567414 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 131/266] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:21 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1743 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:21.821247 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-6cc8e00e-641e-45cb-9a29-e458b3a5905e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:21.829854 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-6cc8e00e-641e-45cb-9a29-e458b3a5905e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1265 microversion: 2.1 time: 0.313983 Nov 02 07:31:21.830517 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 136/267] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:21 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:21.979741 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2011de46-4652-4a3a-a875-ce7c1deed658 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:21.980355 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-2011de46-4652-4a3a-a875-ce7c1deed658 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:21.986769 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2011de46-4652-4a3a-a875-ce7c1deed658 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:21.987167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2011de46-4652-4a3a-a875-ce7c1deed658 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:21.987782 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2011de46-4652-4a3a-a875-ce7c1deed658 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:21.988489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2011de46-4652-4a3a-a875-ce7c1deed658 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:21.988939 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2011de46-4652-4a3a-a875-ce7c1deed658 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:21.989364 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2011de46-4652-4a3a-a875-ce7c1deed658 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:22.141414 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2011de46-4652-4a3a-a875-ce7c1deed658 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:22.151285 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-2011de46-4652-4a3a-a875-ce7c1deed658 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1502 microversion: 2.1 time: 0.175320 Nov 02 07:31:22.152497 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 132/268] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:21 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:22.179846 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-80faa360-4791-4342-a2d4-03adf6575afa tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "250b6ba4-3717-40bb-9c27-112597aa57f7"}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:22.183401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-80faa360-4791-4342-a2d4-03adf6575afa tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:22.194890 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-80faa360-4791-4342-a2d4-03adf6575afa tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:22.196212 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-80faa360-4791-4342-a2d4-03adf6575afa tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:22.196880 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-80faa360-4791-4342-a2d4-03adf6575afa tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:22.198034 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-80faa360-4791-4342-a2d4-03adf6575afa tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:22.199017 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-80faa360-4791-4342-a2d4-03adf6575afa tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:22.200019 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-80faa360-4791-4342-a2d4-03adf6575afa tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:22.253147 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-80faa360-4791-4342-a2d4-03adf6575afa tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] HTTP exception thrown: Cannot 'attach_volume' instance 983e9075-27cf-4c74-bf6b-ff9fe8a68018 while it is in vm_state rescued Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-80faa360-4791-4342-a2d4-03adf6575afa tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Request method failure captured: Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: POST /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018/os-volume_attachments HTTP/1.1 Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 74 Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhxUEtNtZTs4ic7TO1YHq64wZsN5qBfs97ESDbbUSAfzzoKKF4aWoMtTWeaBh0tZLpMPcjYYxG24mgb4lumO_vWqHxQoVjCNp3JVn1PYMG7yUkIv-CwxwRq4pRuWrgDLhanWDwQK429gy3U8ZyWDQ8-vGuKkNzeaxCqAyS8AZk8aIVo Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: c60cb95cbf734d9b852af2bdcad4e1c0 Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-276708690 Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:31:22.255610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:31:22.256912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c60cb95cbf734d9b852af2bdcad4e1c0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c60cb95cbf734d9b852af2bdcad4e1c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c60cb95cbf734d9b852af2bdcad4e1c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c60cb95cbf734d9b852af2bdcad4e1c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:31:22.256912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-ServerRescueNegativeTestJSON-276708690 Nov 02 07:31:22.256912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: c60cb95cbf734d9b852af2bdcad4e1c0 Nov 02 07:31:22.256912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-276708690 Nov 02 07:31:22.256912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-ServerRescueNegativeTestJSON-276708690-project Nov 02 07:31:22.256912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:31:22.256912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:31:22.256912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 0e571b0f4d6f4fafb71939f501b8deec Nov 02 07:31:22.256912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-ServerRescueNegativeTestJSON-276708690-project Nov 02 07:31:22.256912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Nov 02 07:31:22.256912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {"volumeAttachment": {"volumeId": "250b6ba4-3717-40bb-9c27-112597aa57f7"}} Nov 02 07:31:22.256912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Cannot 'attach_volume' instance 983e9075-27cf-4c74-bf6b-ff9fe8a68018 while it is in vm_state rescued Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'server_id': '983e9075-27cf-4c74-bf6b-ff9fe8a68018', 'body': {'volumeAttachment': {'volumeId': '250b6ba4-3717-40bb-9c27-112597aa57f7'}}} Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 983e9075-27cf-4c74-bf6b-ff9fe8a68018 in vm_state rescued. Cannot attach_volume while the instance is in this state. Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:31:22.257601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 983e9075-27cf-4c74-bf6b-ff9fe8a68018 while it is in vm_state rescued Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:31:22.258862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:31:22.259844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:31:22.259844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:31:22.259844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 983e9075-27cf-4c74-bf6b-ff9fe8a68018 while it is in vm_state rescued Nov 02 07:31:22.259844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:31:22.259844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-80faa360-4791-4342-a2d4-03adf6575afa tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Returning 409 to user: Cannot 'attach_volume' instance 983e9075-27cf-4c74-bf6b-ff9fe8a68018 while it is in vm_state rescued {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:31:22.259844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-80faa360-4791-4342-a2d4-03adf6575afa tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "POST /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.082347 Nov 02 07:31:22.267212 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-cb85f50c-f3b1-4f84-970d-2592b42111c8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:22.267747 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-cb85f50c-f3b1-4f84-970d-2592b42111c8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:22.272609 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 137/269] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 07:31:22 2022] POST /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018/os-volume_attachments => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 07:31:22.274115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cb85f50c-f3b1-4f84-970d-2592b42111c8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:22.274639 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cb85f50c-f3b1-4f84-970d-2592b42111c8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:22.275077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cb85f50c-f3b1-4f84-970d-2592b42111c8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:22.275775 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cb85f50c-f3b1-4f84-970d-2592b42111c8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:22.276228 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cb85f50c-f3b1-4f84-970d-2592b42111c8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:22.276649 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cb85f50c-f3b1-4f84-970d-2592b42111c8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:22.359840 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f6d94c43-fbb5-4df0-a172-7108bf949026 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:22.360454 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f6d94c43-fbb5-4df0-a172-7108bf949026 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:22.377079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6d94c43-fbb5-4df0-a172-7108bf949026 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:22.377757 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6d94c43-fbb5-4df0-a172-7108bf949026 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:22.378340 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6d94c43-fbb5-4df0-a172-7108bf949026 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:22.379236 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6d94c43-fbb5-4df0-a172-7108bf949026 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:22.379840 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6d94c43-fbb5-4df0-a172-7108bf949026 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:22.383749 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6d94c43-fbb5-4df0-a172-7108bf949026 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:22.417733 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-cb85f50c-f3b1-4f84-970d-2592b42111c8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "POST /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018/action" status: 202 len: 0 microversion: 2.1 time: 0.154473 Nov 02 07:31:22.429205 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 133/270] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 07:31:22 2022] POST /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:31:22.441760 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1b166d9b-8d3e-40da-82cd-8fbe3d475806 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:22.442386 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1b166d9b-8d3e-40da-82cd-8fbe3d475806 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:22.461004 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b166d9b-8d3e-40da-82cd-8fbe3d475806 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:22.461888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b166d9b-8d3e-40da-82cd-8fbe3d475806 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:22.462836 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b166d9b-8d3e-40da-82cd-8fbe3d475806 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:22.463849 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b166d9b-8d3e-40da-82cd-8fbe3d475806 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:22.465046 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b166d9b-8d3e-40da-82cd-8fbe3d475806 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:22.465754 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b166d9b-8d3e-40da-82cd-8fbe3d475806 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:22.510296 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f6d94c43-fbb5-4df0-a172-7108bf949026 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:22.520490 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f6d94c43-fbb5-4df0-a172-7108bf949026 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1271 microversion: 2.1 time: 0.164898 Nov 02 07:31:22.521234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 138/271] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:22 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:22.599412 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-90081335-d1ea-41d6-8ff9-248df9c41f2e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:22.599729 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-90081335-d1ea-41d6-8ff9-248df9c41f2e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:22.606256 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-90081335-d1ea-41d6-8ff9-248df9c41f2e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:22.606693 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-90081335-d1ea-41d6-8ff9-248df9c41f2e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:22.607888 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-90081335-d1ea-41d6-8ff9-248df9c41f2e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:22.608917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-90081335-d1ea-41d6-8ff9-248df9c41f2e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:22.609610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-90081335-d1ea-41d6-8ff9-248df9c41f2e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:22.610239 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-90081335-d1ea-41d6-8ff9-248df9c41f2e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:23.003604 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1b166d9b-8d3e-40da-82cd-8fbe3d475806 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:23.011930 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-1b166d9b-8d3e-40da-82cd-8fbe3d475806 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1510 microversion: 2.1 time: 0.578381 Nov 02 07:31:23.018128 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 134/272] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:22 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1510 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:23.034852 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-384c4ba5-fb90-4814-a827-c5bbad8ca1e5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:23.036356 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-384c4ba5-fb90-4814-a827-c5bbad8ca1e5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:23.048365 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-384c4ba5-fb90-4814-a827-c5bbad8ca1e5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:23.051280 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-384c4ba5-fb90-4814-a827-c5bbad8ca1e5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:23.053378 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-384c4ba5-fb90-4814-a827-c5bbad8ca1e5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:23.055118 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-384c4ba5-fb90-4814-a827-c5bbad8ca1e5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:23.057509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-384c4ba5-fb90-4814-a827-c5bbad8ca1e5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:23.059521 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-384c4ba5-fb90-4814-a827-c5bbad8ca1e5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:23.143014 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-90081335-d1ea-41d6-8ff9-248df9c41f2e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:23.155268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-90081335-d1ea-41d6-8ff9-248df9c41f2e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:23.157292 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-90081335-d1ea-41d6-8ff9-248df9c41f2e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:23.159038 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-90081335-d1ea-41d6-8ff9-248df9c41f2e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1738 microversion: 2.20 time: 0.565994 Nov 02 07:31:23.159806 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 139/273] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:22 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1738 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:31:23.164439 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-8dc78775-125f-479f-91d5-e76bfc3205e1 req-83ed056b-d28b-4bec-a01a-fc14873e7a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae04f42-6d0d-42e5-ae5f-8022b6f546df", "name": "network-vif-plugged", "status": "completed", "tag": "ba58ff3d-570b-447a-86ec-a6d9a70152fc"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:23.175122 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-8dc78775-125f-479f-91d5-e76bfc3205e1 req-83ed056b-d28b-4bec-a01a-fc14873e7a47 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:23.175929 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-8dc78775-125f-479f-91d5-e76bfc3205e1 req-83ed056b-d28b-4bec-a01a-fc14873e7a47 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:23.176560 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-8dc78775-125f-479f-91d5-e76bfc3205e1 req-83ed056b-d28b-4bec-a01a-fc14873e7a47 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:23.189596 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-8dc78775-125f-479f-91d5-e76bfc3205e1 req-83ed056b-d28b-4bec-a01a-fc14873e7a47 service nova] Creating event network-vif-plugged:ba58ff3d-570b-447a-86ec-a6d9a70152fc for instance cae04f42-6d0d-42e5-ae5f-8022b6f546df on hv-cinder-80473 Nov 02 07:31:23.195216 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-8dc78775-125f-479f-91d5-e76bfc3205e1 req-83ed056b-d28b-4bec-a01a-fc14873e7a47 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034039 Nov 02 07:31:23.196506 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 140/274] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:31:23.535363 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-384c4ba5-fb90-4814-a827-c5bbad8ca1e5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:23.547049 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-384c4ba5-fb90-4814-a827-c5bbad8ca1e5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1265 microversion: 2.1 time: 0.525593 Nov 02 07:31:23.551320 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-23a4e480-586b-42ac-988a-f2841fa8e51d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:23.552714 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-23a4e480-586b-42ac-988a-f2841fa8e51d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:23.562964 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 135/275] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:23 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1265 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:23.569422 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-23a4e480-586b-42ac-988a-f2841fa8e51d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:23.570195 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-23a4e480-586b-42ac-988a-f2841fa8e51d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:23.570915 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-23a4e480-586b-42ac-988a-f2841fa8e51d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:23.571824 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-23a4e480-586b-42ac-988a-f2841fa8e51d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:23.572376 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-23a4e480-586b-42ac-988a-f2841fa8e51d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:23.573075 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-23a4e480-586b-42ac-988a-f2841fa8e51d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:23.710878 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-23a4e480-586b-42ac-988a-f2841fa8e51d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:23.733202 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-23a4e480-586b-42ac-988a-f2841fa8e51d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1271 microversion: 2.1 time: 0.186513 Nov 02 07:31:23.734374 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 141/276] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:23 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:24.042254 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c1de2ba1-5b14-475a-9b29-adf89a043bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:24.042901 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c1de2ba1-5b14-475a-9b29-adf89a043bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:24.056968 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c1de2ba1-5b14-475a-9b29-adf89a043bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:24.059193 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c1de2ba1-5b14-475a-9b29-adf89a043bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:24.061239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c1de2ba1-5b14-475a-9b29-adf89a043bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:24.063277 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c1de2ba1-5b14-475a-9b29-adf89a043bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:24.064431 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c1de2ba1-5b14-475a-9b29-adf89a043bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:24.065262 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c1de2ba1-5b14-475a-9b29-adf89a043bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:24.192659 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8f4cc13e-45b3-47b2-8504-fe9bfbdccc3b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:24.194806 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8f4cc13e-45b3-47b2-8504-fe9bfbdccc3b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:24.206322 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8f4cc13e-45b3-47b2-8504-fe9bfbdccc3b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:24.207204 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8f4cc13e-45b3-47b2-8504-fe9bfbdccc3b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:24.207896 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8f4cc13e-45b3-47b2-8504-fe9bfbdccc3b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:24.208994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8f4cc13e-45b3-47b2-8504-fe9bfbdccc3b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:24.209758 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8f4cc13e-45b3-47b2-8504-fe9bfbdccc3b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:24.210834 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8f4cc13e-45b3-47b2-8504-fe9bfbdccc3b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:24.333788 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c1de2ba1-5b14-475a-9b29-adf89a043bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:24.345163 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c1de2ba1-5b14-475a-9b29-adf89a043bb7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1510 microversion: 2.1 time: 0.307824 Nov 02 07:31:24.359779 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 136/277] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:24 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1510 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:24.423300 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8f4cc13e-45b3-47b2-8504-fe9bfbdccc3b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:24.432110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8f4cc13e-45b3-47b2-8504-fe9bfbdccc3b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:24.436341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8f4cc13e-45b3-47b2-8504-fe9bfbdccc3b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:24.437574 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8f4cc13e-45b3-47b2-8504-fe9bfbdccc3b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1738 microversion: 2.20 time: 0.252269 Nov 02 07:31:24.438141 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 142/278] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:24 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:31:24.584750 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0ac375e1-bae8-4111-9d87-5b3ed01f4424 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:24.585385 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-0ac375e1-bae8-4111-9d87-5b3ed01f4424 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:24.594045 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0ac375e1-bae8-4111-9d87-5b3ed01f4424 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:24.594568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0ac375e1-bae8-4111-9d87-5b3ed01f4424 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:24.595005 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0ac375e1-bae8-4111-9d87-5b3ed01f4424 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:24.597695 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0ac375e1-bae8-4111-9d87-5b3ed01f4424 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:24.598161 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0ac375e1-bae8-4111-9d87-5b3ed01f4424 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:24.609587 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0ac375e1-bae8-4111-9d87-5b3ed01f4424 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:24.761992 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-1e2457c7-8ddc-46f5-8502-eb3ae15ae653 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:24.765777 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-1e2457c7-8ddc-46f5-8502-eb3ae15ae653 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:24.774732 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1e2457c7-8ddc-46f5-8502-eb3ae15ae653 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:24.775224 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1e2457c7-8ddc-46f5-8502-eb3ae15ae653 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:24.775659 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1e2457c7-8ddc-46f5-8502-eb3ae15ae653 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:24.776361 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1e2457c7-8ddc-46f5-8502-eb3ae15ae653 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:24.776813 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1e2457c7-8ddc-46f5-8502-eb3ae15ae653 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:24.777232 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1e2457c7-8ddc-46f5-8502-eb3ae15ae653 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:24.845177 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-0ac375e1-bae8-4111-9d87-5b3ed01f4424 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:24.853966 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-0ac375e1-bae8-4111-9d87-5b3ed01f4424 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1265 microversion: 2.1 time: 0.287592 Nov 02 07:31:24.858409 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 137/279] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:24 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1265 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:25.027749 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-1e2457c7-8ddc-46f5-8502-eb3ae15ae653 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:25.040792 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-1e2457c7-8ddc-46f5-8502-eb3ae15ae653 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1313 microversion: 2.1 time: 0.282876 Nov 02 07:31:25.043815 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 143/280] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:24 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:25.375650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-5004b1be-2d01-42da-8dd7-dfb59e15d72a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:25.376813 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-5004b1be-2d01-42da-8dd7-dfb59e15d72a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:25.391670 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5004b1be-2d01-42da-8dd7-dfb59e15d72a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:25.393653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5004b1be-2d01-42da-8dd7-dfb59e15d72a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:25.394101 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5004b1be-2d01-42da-8dd7-dfb59e15d72a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:25.400143 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5004b1be-2d01-42da-8dd7-dfb59e15d72a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:25.400846 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5004b1be-2d01-42da-8dd7-dfb59e15d72a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:25.401576 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5004b1be-2d01-42da-8dd7-dfb59e15d72a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:25.477519 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c05493be-f1eb-4d64-957d-73bf388add64 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:25.478381 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c05493be-f1eb-4d64-957d-73bf388add64 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:25.485509 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c05493be-f1eb-4d64-957d-73bf388add64 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:25.488836 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c05493be-f1eb-4d64-957d-73bf388add64 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:25.489557 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c05493be-f1eb-4d64-957d-73bf388add64 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:25.490288 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c05493be-f1eb-4d64-957d-73bf388add64 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:25.492421 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c05493be-f1eb-4d64-957d-73bf388add64 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:25.494001 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c05493be-f1eb-4d64-957d-73bf388add64 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:25.869204 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c05493be-f1eb-4d64-957d-73bf388add64 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:25.873314 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-5004b1be-2d01-42da-8dd7-dfb59e15d72a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:25.885722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-5004b1be-2d01-42da-8dd7-dfb59e15d72a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1510 microversion: 2.1 time: 0.514863 Nov 02 07:31:25.888733 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 138/281] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:25 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1510 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:25.889574 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c05493be-f1eb-4d64-957d-73bf388add64 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:25.893140 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c05493be-f1eb-4d64-957d-73bf388add64 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:25.895319 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c05493be-f1eb-4d64-957d-73bf388add64 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1738 microversion: 2.20 time: 0.431297 Nov 02 07:31:25.908136 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9eebff2b-229a-4b58-bc24-3c030e1bf73e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:25.909476 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9eebff2b-229a-4b58-bc24-3c030e1bf73e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:25.912702 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 144/282] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:25 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1738 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:31:25.917787 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9eebff2b-229a-4b58-bc24-3c030e1bf73e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:25.918313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9eebff2b-229a-4b58-bc24-3c030e1bf73e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:25.918909 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9eebff2b-229a-4b58-bc24-3c030e1bf73e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:25.919903 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9eebff2b-229a-4b58-bc24-3c030e1bf73e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:25.920430 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9eebff2b-229a-4b58-bc24-3c030e1bf73e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:25.920857 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9eebff2b-229a-4b58-bc24-3c030e1bf73e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:26.072082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8b801f23-247b-49b7-b079-77dc6be72323 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:26.072707 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8b801f23-247b-49b7-b079-77dc6be72323 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:26.086506 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b801f23-247b-49b7-b079-77dc6be72323 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:26.088369 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b801f23-247b-49b7-b079-77dc6be72323 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:26.088833 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b801f23-247b-49b7-b079-77dc6be72323 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:26.091225 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b801f23-247b-49b7-b079-77dc6be72323 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:26.093511 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b801f23-247b-49b7-b079-77dc6be72323 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:26.093960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b801f23-247b-49b7-b079-77dc6be72323 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:26.282783 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9eebff2b-229a-4b58-bc24-3c030e1bf73e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:26.300605 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9eebff2b-229a-4b58-bc24-3c030e1bf73e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1265 microversion: 2.1 time: 0.400567 Nov 02 07:31:26.301189 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 139/283] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:25 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1265 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:26.389259 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8b801f23-247b-49b7-b079-77dc6be72323 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:26.395838 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=100 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:26.399339 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8b801f23-247b-49b7-b079-77dc6be72323 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1313 microversion: 2.1 time: 0.333169 Nov 02 07:31:26.414924 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 145/284] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:26 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:26.912989 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-85e90768-6c0f-459a-93db-dd8c67102274 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:26.913643 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-85e90768-6c0f-459a-93db-dd8c67102274 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:26.921215 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-85e90768-6c0f-459a-93db-dd8c67102274 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:26.921590 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-85e90768-6c0f-459a-93db-dd8c67102274 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:26.922225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-85e90768-6c0f-459a-93db-dd8c67102274 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:26.923120 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-85e90768-6c0f-459a-93db-dd8c67102274 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:26.924304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-85e90768-6c0f-459a-93db-dd8c67102274 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:26.924885 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-85e90768-6c0f-459a-93db-dd8c67102274 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:26.934233 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5508eaee-87c2-48d5-9550-4cd9e90d68d9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:26.935045 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-5508eaee-87c2-48d5-9550-4cd9e90d68d9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:26.950262 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5508eaee-87c2-48d5-9550-4cd9e90d68d9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:26.953878 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5508eaee-87c2-48d5-9550-4cd9e90d68d9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:26.954233 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5508eaee-87c2-48d5-9550-4cd9e90d68d9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:26.955222 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5508eaee-87c2-48d5-9550-4cd9e90d68d9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:26.956014 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5508eaee-87c2-48d5-9550-4cd9e90d68d9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:26.956308 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5508eaee-87c2-48d5-9550-4cd9e90d68d9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:27.690092 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-5508eaee-87c2-48d5-9550-4cd9e90d68d9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:27.693186 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-85e90768-6c0f-459a-93db-dd8c67102274 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:27.713650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-85e90768-6c0f-459a-93db-dd8c67102274 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1516 microversion: 2.1 time: 0.804413 Nov 02 07:31:27.716575 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-5508eaee-87c2-48d5-9550-4cd9e90d68d9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:27.734457 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 140/285] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:26 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1516 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:27.742860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-5508eaee-87c2-48d5-9550-4cd9e90d68d9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:27.742986 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-eedab3b7-892f-4a49-b1bd-0def52926684 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:27.743238 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-eedab3b7-892f-4a49-b1bd-0def52926684 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:27.745615 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-5508eaee-87c2-48d5-9550-4cd9e90d68d9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1738 microversion: 2.20 time: 0.823130 Nov 02 07:31:27.746188 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 146/286] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:26 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1738 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:31:27.750501 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eedab3b7-892f-4a49-b1bd-0def52926684 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:27.751261 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eedab3b7-892f-4a49-b1bd-0def52926684 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:27.752409 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eedab3b7-892f-4a49-b1bd-0def52926684 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:27.753436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eedab3b7-892f-4a49-b1bd-0def52926684 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:27.754571 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eedab3b7-892f-4a49-b1bd-0def52926684 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:27.755508 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eedab3b7-892f-4a49-b1bd-0def52926684 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:27.764312 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-e01efa48-4f5c-43b5-9297-475289303cf7 req-be7643fa-b5d1-452f-9239-9282cb1af745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b5c7853-1758-4e70-86c7-5f1bfd998ca6", "tag": "1fbf5f86-26a9-44e9-866d-6515a0736725"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:27.788949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-e01efa48-4f5c-43b5-9297-475289303cf7 req-be7643fa-b5d1-452f-9239-9282cb1af745 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:27.789426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-e01efa48-4f5c-43b5-9297-475289303cf7 req-be7643fa-b5d1-452f-9239-9282cb1af745 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:27.789854 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-e01efa48-4f5c-43b5-9297-475289303cf7 req-be7643fa-b5d1-452f-9239-9282cb1af745 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:27.825568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-e01efa48-4f5c-43b5-9297-475289303cf7 req-be7643fa-b5d1-452f-9239-9282cb1af745 service nova] Creating event network-changed:1fbf5f86-26a9-44e9-866d-6515a0736725 for instance 2b5c7853-1758-4e70-86c7-5f1bfd998ca6 on hv-cinder-80473 Nov 02 07:31:27.830983 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-e01efa48-4f5c-43b5-9297-475289303cf7 req-be7643fa-b5d1-452f-9239-9282cb1af745 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070323 Nov 02 07:31:27.831588 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 147/287] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:31:27.837783 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-6b082c8d-e75c-4aa5-b711-062e629d2646 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:27.839281 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-6b082c8d-e75c-4aa5-b711-062e629d2646 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:27.846877 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6b082c8d-e75c-4aa5-b711-062e629d2646 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:27.850132 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6b082c8d-e75c-4aa5-b711-062e629d2646 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:27.850340 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6b082c8d-e75c-4aa5-b711-062e629d2646 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:27.851004 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6b082c8d-e75c-4aa5-b711-062e629d2646 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:27.851458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6b082c8d-e75c-4aa5-b711-062e629d2646 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:27.851881 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6b082c8d-e75c-4aa5-b711-062e629d2646 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:28.263068 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-eedab3b7-892f-4a49-b1bd-0def52926684 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:28.270449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-6b082c8d-e75c-4aa5-b711-062e629d2646 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:28.279573 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-eedab3b7-892f-4a49-b1bd-0def52926684 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1265 microversion: 2.1 time: 0.543773 Nov 02 07:31:28.280290 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-6b082c8d-e75c-4aa5-b711-062e629d2646 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1313 microversion: 2.1 time: 0.447366 Nov 02 07:31:28.281659 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 141/288] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:27 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1265 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:28.285331 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 148/289] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:27 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:28.777151 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-fc19dbc5-d360-43ce-8e6e-a9a7c712b99f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:28.777969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-fc19dbc5-d360-43ce-8e6e-a9a7c712b99f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:28.785003 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=4 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:28.787360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc19dbc5-d360-43ce-8e6e-a9a7c712b99f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:28.788111 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc19dbc5-d360-43ce-8e6e-a9a7c712b99f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:28.788838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc19dbc5-d360-43ce-8e6e-a9a7c712b99f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:28.789973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc19dbc5-d360-43ce-8e6e-a9a7c712b99f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:28.790588 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc19dbc5-d360-43ce-8e6e-a9a7c712b99f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:28.791584 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc19dbc5-d360-43ce-8e6e-a9a7c712b99f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:29.064780 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=16 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:29.112288 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fc19dbc5-d360-43ce-8e6e-a9a7c712b99f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:29.135410 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fc19dbc5-d360-43ce-8e6e-a9a7c712b99f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:29.136928 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fc19dbc5-d360-43ce-8e6e-a9a7c712b99f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:29.138108 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-fc19dbc5-d360-43ce-8e6e-a9a7c712b99f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1738 microversion: 2.20 time: 0.366310 Nov 02 07:31:29.152037 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 142/290] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:28 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1738 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:29.307268 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2222f355-c863-4125-bc80-3bc4e7a58d0d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:29.307885 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-2222f355-c863-4125-bc80-3bc4e7a58d0d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:29.310831 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-76e86040-1742-4b35-95c9-afcadf1faeb0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:29.311991 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-76e86040-1742-4b35-95c9-afcadf1faeb0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:29.333171 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2222f355-c863-4125-bc80-3bc4e7a58d0d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:29.334107 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2222f355-c863-4125-bc80-3bc4e7a58d0d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:29.334836 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-76e86040-1742-4b35-95c9-afcadf1faeb0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:29.335348 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2222f355-c863-4125-bc80-3bc4e7a58d0d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:29.336160 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-76e86040-1742-4b35-95c9-afcadf1faeb0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:29.337074 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2222f355-c863-4125-bc80-3bc4e7a58d0d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:29.337697 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-76e86040-1742-4b35-95c9-afcadf1faeb0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:29.338332 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2222f355-c863-4125-bc80-3bc4e7a58d0d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:29.339456 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-76e86040-1742-4b35-95c9-afcadf1faeb0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:29.339869 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-76e86040-1742-4b35-95c9-afcadf1faeb0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:29.340336 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-76e86040-1742-4b35-95c9-afcadf1faeb0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:29.343622 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2222f355-c863-4125-bc80-3bc4e7a58d0d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:29.387100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:29.589289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-76e86040-1742-4b35-95c9-afcadf1faeb0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:29.608581 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-76e86040-1742-4b35-95c9-afcadf1faeb0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1313 microversion: 2.1 time: 0.304335 Nov 02 07:31:29.609442 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 149/291] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:29 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:29.620608 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-3aaf2f96-9ae9-4097-9b21-e78829f6caa3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Action: 'create', calling method: .version_select at 0x7f4d6a456550>, body: {"keypair": {"name": "tempest-keypair-1345587460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNres6o91TgYqwySe+bIr/NHGbSnHP8KPdqX6N+svzgKs9OXXtCv4jcij5WquxK57ULzo+aZ9bnzUtQ+SPN9PqTOSc7WHZEpcOALdpTYbMB35GXQLQs+u3ukJlrnzjkyTg=="}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:29.668709 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-3aaf2f96-9ae9-4097-9b21-e78829f6caa3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Getting quotas for project c60cb95cbf734d9b852af2bdcad4e1c0. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:31:29.678784 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-3aaf2f96-9ae9-4097-9b21-e78829f6caa3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Getting quotas for user 0e571b0f4d6f4fafb71939f501b8deec and project c60cb95cbf734d9b852af2bdcad4e1c0. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:31:29.688975 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2222f355-c863-4125-bc80-3bc4e7a58d0d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:29.703187 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-2222f355-c863-4125-bc80-3bc4e7a58d0d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1265 microversion: 2.1 time: 0.399524 Nov 02 07:31:29.703849 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 143/292] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:29 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1265 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:29.749259 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-3aaf2f96-9ae9-4097-9b21-e78829f6caa3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.136911 Nov 02 07:31:29.750434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 150/293] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 07:31:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:31:30.181189 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-57652635-7ec5-4ece-9b87-1d05f4832b69 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:30.181796 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-57652635-7ec5-4ece-9b87-1d05f4832b69 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:30.188546 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-57652635-7ec5-4ece-9b87-1d05f4832b69 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:30.189037 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-57652635-7ec5-4ece-9b87-1d05f4832b69 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:30.189474 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-57652635-7ec5-4ece-9b87-1d05f4832b69 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:30.190179 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-57652635-7ec5-4ece-9b87-1d05f4832b69 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:30.190662 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-57652635-7ec5-4ece-9b87-1d05f4832b69 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:30.191086 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-57652635-7ec5-4ece-9b87-1d05f4832b69 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:30.559387 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-57652635-7ec5-4ece-9b87-1d05f4832b69 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:30.587883 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-57652635-7ec5-4ece-9b87-1d05f4832b69 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:30.591131 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-57652635-7ec5-4ece-9b87-1d05f4832b69 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:30.596339 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-57652635-7ec5-4ece-9b87-1d05f4832b69 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1738 microversion: 2.20 time: 0.418830 Nov 02 07:31:30.597095 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 144/294] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:30 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1738 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:30.636331 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-537a5901-1e0d-479e-a245-cbc1830f088d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:30.637631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-537a5901-1e0d-479e-a245-cbc1830f088d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:30.664135 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-537a5901-1e0d-479e-a245-cbc1830f088d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:30.664720 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-537a5901-1e0d-479e-a245-cbc1830f088d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:30.665217 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-537a5901-1e0d-479e-a245-cbc1830f088d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:30.666156 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-537a5901-1e0d-479e-a245-cbc1830f088d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:30.666813 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-537a5901-1e0d-479e-a245-cbc1830f088d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:30.667802 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-537a5901-1e0d-479e-a245-cbc1830f088d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:30.727824 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a84b43f3-5fa0-4773-a9cd-90c25cab2229 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:30.728539 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a84b43f3-5fa0-4773-a9cd-90c25cab2229 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:30.736518 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a84b43f3-5fa0-4773-a9cd-90c25cab2229 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:30.743314 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a84b43f3-5fa0-4773-a9cd-90c25cab2229 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:30.748148 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a84b43f3-5fa0-4773-a9cd-90c25cab2229 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:30.749095 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a84b43f3-5fa0-4773-a9cd-90c25cab2229 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:30.752256 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a84b43f3-5fa0-4773-a9cd-90c25cab2229 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:30.757707 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a84b43f3-5fa0-4773-a9cd-90c25cab2229 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:31.121632 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a84b43f3-5fa0-4773-a9cd-90c25cab2229 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:31.132009 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a84b43f3-5fa0-4773-a9cd-90c25cab2229 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1265 microversion: 2.1 time: 0.407941 Nov 02 07:31:31.139017 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-537a5901-1e0d-479e-a245-cbc1830f088d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:31.152533 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-537a5901-1e0d-479e-a245-cbc1830f088d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1313 microversion: 2.1 time: 0.520136 Nov 02 07:31:31.155314 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 145/295] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:30 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1265 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:31.155819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 151/296] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:30 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1313 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:31.490489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-6c22c244-5a82-42f3-812a-eb01a047516b req-7d8f4937-d469-4571-a7e6-9f8c2c8f71b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c89d505-bb4e-469f-bcb9-c336439e865a", "name": "network-vif-plugged", "status": "completed", "tag": "417309a1-1746-4c69-89dd-ecf6b6199572"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:31.515473 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-6c22c244-5a82-42f3-812a-eb01a047516b req-7d8f4937-d469-4571-a7e6-9f8c2c8f71b3 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:31.516095 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-6c22c244-5a82-42f3-812a-eb01a047516b req-7d8f4937-d469-4571-a7e6-9f8c2c8f71b3 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:31.517324 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-6c22c244-5a82-42f3-812a-eb01a047516b req-7d8f4937-d469-4571-a7e6-9f8c2c8f71b3 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:31.567878 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-6c22c244-5a82-42f3-812a-eb01a047516b req-7d8f4937-d469-4571-a7e6-9f8c2c8f71b3 service nova] Creating event network-vif-plugged:417309a1-1746-4c69-89dd-ecf6b6199572 for instance 4c89d505-bb4e-469f-bcb9-c336439e865a on hv-cinder-80473 Nov 02 07:31:31.582749 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-6c22c244-5a82-42f3-812a-eb01a047516b req-7d8f4937-d469-4571-a7e6-9f8c2c8f71b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096038 Nov 02 07:31:31.584219 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 146/297] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:31:31.626752 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c255be8a-9d13-4972-b937-c7cd8abaee4f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:31.628773 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c255be8a-9d13-4972-b937-c7cd8abaee4f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:31.644563 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c255be8a-9d13-4972-b937-c7cd8abaee4f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:31.645747 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c255be8a-9d13-4972-b937-c7cd8abaee4f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:31.647503 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c255be8a-9d13-4972-b937-c7cd8abaee4f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:31.649469 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c255be8a-9d13-4972-b937-c7cd8abaee4f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:31.650144 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c255be8a-9d13-4972-b937-c7cd8abaee4f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:31.650757 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c255be8a-9d13-4972-b937-c7cd8abaee4f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:32.040477 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c255be8a-9d13-4972-b937-c7cd8abaee4f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:32.058798 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c255be8a-9d13-4972-b937-c7cd8abaee4f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:32.066884 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c255be8a-9d13-4972-b937-c7cd8abaee4f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:32.068656 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c255be8a-9d13-4972-b937-c7cd8abaee4f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1738 microversion: 2.20 time: 0.447670 Nov 02 07:31:32.069802 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 152/298] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:31 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1738 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:32.182537 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-047e4074-4f7b-4366-b462-436467e6159e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:32.189804 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-84f88b36-59b9-4f67-a2c2-3c0553524edb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:32.190162 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-047e4074-4f7b-4366-b462-436467e6159e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:32.192904 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-84f88b36-59b9-4f67-a2c2-3c0553524edb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:32.219278 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-047e4074-4f7b-4366-b462-436467e6159e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:32.220194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-047e4074-4f7b-4366-b462-436467e6159e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:32.222379 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-84f88b36-59b9-4f67-a2c2-3c0553524edb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:32.222880 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-047e4074-4f7b-4366-b462-436467e6159e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:32.223626 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-047e4074-4f7b-4366-b462-436467e6159e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:32.224089 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-047e4074-4f7b-4366-b462-436467e6159e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:32.224510 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-047e4074-4f7b-4366-b462-436467e6159e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:32.227023 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-84f88b36-59b9-4f67-a2c2-3c0553524edb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:32.227804 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-84f88b36-59b9-4f67-a2c2-3c0553524edb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:32.232576 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-84f88b36-59b9-4f67-a2c2-3c0553524edb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:32.233496 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-84f88b36-59b9-4f67-a2c2-3c0553524edb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:32.234099 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-84f88b36-59b9-4f67-a2c2-3c0553524edb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:32.814843 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-84f88b36-59b9-4f67-a2c2-3c0553524edb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:32.834754 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-84f88b36-59b9-4f67-a2c2-3c0553524edb tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1265 microversion: 2.1 time: 0.648114 Nov 02 07:31:32.835702 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 147/299] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:32 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1265 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:32.866176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-047e4074-4f7b-4366-b462-436467e6159e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:32.881641 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-047e4074-4f7b-4366-b462-436467e6159e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1313 microversion: 2.1 time: 0.708014 Nov 02 07:31:32.884778 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 153/300] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:32 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1313 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:33.097794 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-fd0d2280-4ee6-48d0-891b-3cd3c659b0f4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:33.098537 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-fd0d2280-4ee6-48d0-891b-3cd3c659b0f4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:33.109519 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd0d2280-4ee6-48d0-891b-3cd3c659b0f4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:33.110215 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd0d2280-4ee6-48d0-891b-3cd3c659b0f4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:33.110464 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd0d2280-4ee6-48d0-891b-3cd3c659b0f4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:33.115060 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd0d2280-4ee6-48d0-891b-3cd3c659b0f4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:33.117283 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd0d2280-4ee6-48d0-891b-3cd3c659b0f4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:33.117936 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd0d2280-4ee6-48d0-891b-3cd3c659b0f4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:33.486006 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fd0d2280-4ee6-48d0-891b-3cd3c659b0f4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:33.494319 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fd0d2280-4ee6-48d0-891b-3cd3c659b0f4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:33.496755 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fd0d2280-4ee6-48d0-891b-3cd3c659b0f4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:33.498002 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-fd0d2280-4ee6-48d0-891b-3cd3c659b0f4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1738 microversion: 2.20 time: 0.404246 Nov 02 07:31:33.498583 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 148/301] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:33 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1738 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:33.603367 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1444848593", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f40ed210-eb7b-4935-8be8-8b7615c77c12"}], "security_groups": [{"name": "tempest-securitygroup--328156128"}], "key_name": "tempest-keypair-1345587460", "user_data": "}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:33.762341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.network.neutron [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] validate_networks() for [('f40ed210-eb7b-4935-8be8-8b7615c77c12', None, None, None, None, None)] {{(pid=118991) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:31:33.858086 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-aed203e3-8aae-4e97-a40b-d8539d700f08 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:33.858851 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-aed203e3-8aae-4e97-a40b-d8539d700f08 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:33.889837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aed203e3-8aae-4e97-a40b-d8539d700f08 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:33.891710 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aed203e3-8aae-4e97-a40b-d8539d700f08 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:33.892198 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aed203e3-8aae-4e97-a40b-d8539d700f08 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:33.892963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aed203e3-8aae-4e97-a40b-d8539d700f08 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:33.893430 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aed203e3-8aae-4e97-a40b-d8539d700f08 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:33.893860 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aed203e3-8aae-4e97-a40b-d8539d700f08 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:34.240695 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-aed203e3-8aae-4e97-a40b-d8539d700f08 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:34.252187 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-aed203e3-8aae-4e97-a40b-d8539d700f08 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1452 microversion: 2.1 time: 0.397464 Nov 02 07:31:34.252791 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 149/302] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:33 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1452 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:34.263073 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0af33128-5646-4236-b3b5-2da0cd0db3a9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:34.264428 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-0af33128-5646-4236-b3b5-2da0cd0db3a9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:34.283635 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0af33128-5646-4236-b3b5-2da0cd0db3a9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:34.284209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0af33128-5646-4236-b3b5-2da0cd0db3a9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:34.284679 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0af33128-5646-4236-b3b5-2da0cd0db3a9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:34.285425 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0af33128-5646-4236-b3b5-2da0cd0db3a9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:34.285878 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0af33128-5646-4236-b3b5-2da0cd0db3a9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:34.286320 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0af33128-5646-4236-b3b5-2da0cd0db3a9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:34.737846 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Flavor limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:31:34.738514 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Image limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:31:34.738769 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Flavor pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:31:34.739178 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Image pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:31:34.739974 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:31:34.755783 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:34.765067 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:34.765904 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:34.766937 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:34.767574 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:34.768162 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:34.814137 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Getting quotas for project c60cb95cbf734d9b852af2bdcad4e1c0. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:31:34.815676 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-0af33128-5646-4236-b3b5-2da0cd0db3a9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:34.826974 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-0af33128-5646-4236-b3b5-2da0cd0db3a9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1313 microversion: 2.1 time: 0.567322 Nov 02 07:31:34.827258 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Getting quotas for user 0e571b0f4d6f4fafb71939f501b8deec and project c60cb95cbf734d9b852af2bdcad4e1c0. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:31:34.828309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 150/303] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:34 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1313 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:34.834449 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c9a5a9b7-44d8-47f4-ab8d-5adda8a08e87 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:34.835283 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c9a5a9b7-44d8-47f4-ab8d-5adda8a08e87 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:34.843275 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c9a5a9b7-44d8-47f4-ab8d-5adda8a08e87 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:34.843966 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c9a5a9b7-44d8-47f4-ab8d-5adda8a08e87 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:34.844580 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c9a5a9b7-44d8-47f4-ab8d-5adda8a08e87 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:34.846255 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c9a5a9b7-44d8-47f4-ab8d-5adda8a08e87 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:34.846921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c9a5a9b7-44d8-47f4-ab8d-5adda8a08e87 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:34.847492 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c9a5a9b7-44d8-47f4-ab8d-5adda8a08e87 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:34.852394 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Going to run 1 instances... {{(pid=118991) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:31:34.859975 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:31:34.977619 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-3d35b166-207d-411d-b775-56e40aa15313 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.374369 Nov 02 07:31:34.982755 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 154/304] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:31:33 2022] POST /compute/v2.1/servers => generated 408 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 07:31:35.000079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-3b405ab6-7df4-4236-ac7a-e0c00416761e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:35.002511 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-3b405ab6-7df4-4236-ac7a-e0c00416761e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:35.019064 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3b405ab6-7df4-4236-ac7a-e0c00416761e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:35.019694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3b405ab6-7df4-4236-ac7a-e0c00416761e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:35.022635 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3b405ab6-7df4-4236-ac7a-e0c00416761e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:35.023480 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3b405ab6-7df4-4236-ac7a-e0c00416761e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:35.024072 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3b405ab6-7df4-4236-ac7a-e0c00416761e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:35.026204 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3b405ab6-7df4-4236-ac7a-e0c00416761e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:35.040509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c9a5a9b7-44d8-47f4-ab8d-5adda8a08e87 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:35.054131 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c9a5a9b7-44d8-47f4-ab8d-5adda8a08e87 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1452 microversion: 2.1 time: 0.224164 Nov 02 07:31:35.068311 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 151/305] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:34 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1452 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:35.096069 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ef21a2f9-937c-45ea-ba5f-b183a6b045fe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:35.103763 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ef21a2f9-937c-45ea-ba5f-b183a6b045fe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:35.255765 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ef21a2f9-937c-45ea-ba5f-b183a6b045fe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:35.265313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ef21a2f9-937c-45ea-ba5f-b183a6b045fe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1246 microversion: 2.1 time: 0.195591 Nov 02 07:31:35.265890 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 152/306] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:35 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1246 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:35.859586 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-019f61e5-e5fa-4e17-adcb-c1108a4fe943 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:35.860427 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-019f61e5-e5fa-4e17-adcb-c1108a4fe943 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:35.884993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-019f61e5-e5fa-4e17-adcb-c1108a4fe943 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:35.885494 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-019f61e5-e5fa-4e17-adcb-c1108a4fe943 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:35.885931 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-019f61e5-e5fa-4e17-adcb-c1108a4fe943 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:35.886681 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-019f61e5-e5fa-4e17-adcb-c1108a4fe943 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:35.887178 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-019f61e5-e5fa-4e17-adcb-c1108a4fe943 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:35.887606 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-019f61e5-e5fa-4e17-adcb-c1108a4fe943 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:35.904902 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-3b405ab6-7df4-4236-ac7a-e0c00416761e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:35.916442 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-3b405ab6-7df4-4236-ac7a-e0c00416761e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:35.933473 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-3b405ab6-7df4-4236-ac7a-e0c00416761e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:35.944070 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-3b405ab6-7df4-4236-ac7a-e0c00416761e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1738 microversion: 2.20 time: 0.952294 Nov 02 07:31:35.953969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 155/307] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:34 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1738 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:36.292835 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ab589441-c5cc-4996-85f6-c25c1b1d97a3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:36.293873 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-ab589441-c5cc-4996-85f6-c25c1b1d97a3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:36.301367 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ab589441-c5cc-4996-85f6-c25c1b1d97a3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:36.302225 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ab589441-c5cc-4996-85f6-c25c1b1d97a3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:36.302922 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ab589441-c5cc-4996-85f6-c25c1b1d97a3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:36.304571 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ab589441-c5cc-4996-85f6-c25c1b1d97a3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:36.305243 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ab589441-c5cc-4996-85f6-c25c1b1d97a3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:36.306463 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ab589441-c5cc-4996-85f6-c25c1b1d97a3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:36.359024 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-019f61e5-e5fa-4e17-adcb-c1108a4fe943 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:36.373829 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-019f61e5-e5fa-4e17-adcb-c1108a4fe943 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1313 microversion: 2.1 time: 0.516521 Nov 02 07:31:36.395178 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 153/308] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:35 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1313 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:36.545723 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ab589441-c5cc-4996-85f6-c25c1b1d97a3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:36.570392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ab589441-c5cc-4996-85f6-c25c1b1d97a3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1298 microversion: 2.1 time: 0.281601 Nov 02 07:31:36.599096 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 156/309] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:36 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1298 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:36.982690 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-dadef803-f3f3-4d48-b83e-1af395ba76e7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:36.983590 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-dadef803-f3f3-4d48-b83e-1af395ba76e7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:37.000982 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dadef803-f3f3-4d48-b83e-1af395ba76e7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:37.002452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dadef803-f3f3-4d48-b83e-1af395ba76e7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:37.003130 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dadef803-f3f3-4d48-b83e-1af395ba76e7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:37.004221 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dadef803-f3f3-4d48-b83e-1af395ba76e7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:37.004875 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dadef803-f3f3-4d48-b83e-1af395ba76e7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:37.006031 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dadef803-f3f3-4d48-b83e-1af395ba76e7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:37.380080 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-b7963d7f-9623-4703-9a42-357e3fb4c1b6 req-f93fcde0-00db-4d87-be6b-aa14f1b864f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b5c7853-1758-4e70-86c7-5f1bfd998ca6", "name": "network-vif-plugged", "status": "completed", "tag": "1fbf5f86-26a9-44e9-866d-6515a0736725"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:37.407434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-b7963d7f-9623-4703-9a42-357e3fb4c1b6 req-f93fcde0-00db-4d87-be6b-aa14f1b864f2 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:37.414539 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-b7963d7f-9623-4703-9a42-357e3fb4c1b6 req-f93fcde0-00db-4d87-be6b-aa14f1b864f2 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:37.416187 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-b7963d7f-9623-4703-9a42-357e3fb4c1b6 req-f93fcde0-00db-4d87-be6b-aa14f1b864f2 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:37.475495 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-dadef803-f3f3-4d48-b83e-1af395ba76e7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:37.504216 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-dadef803-f3f3-4d48-b83e-1af395ba76e7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:37.506209 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-b7963d7f-9623-4703-9a42-357e3fb4c1b6 req-f93fcde0-00db-4d87-be6b-aa14f1b864f2 service nova] Creating event network-vif-plugged:1fbf5f86-26a9-44e9-866d-6515a0736725 for instance 2b5c7853-1758-4e70-86c7-5f1bfd998ca6 on hv-cinder-80473 Nov 02 07:31:37.511503 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-dadef803-f3f3-4d48-b83e-1af395ba76e7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:37.518455 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-dadef803-f3f3-4d48-b83e-1af395ba76e7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1738 microversion: 2.20 time: 0.540861 Nov 02 07:31:37.520705 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 154/310] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:36 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1738 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:37.530868 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ab63b75a-c30c-4c21-9333-ea88694c59f3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:37.533015 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-b7963d7f-9623-4703-9a42-357e3fb4c1b6 req-f93fcde0-00db-4d87-be6b-aa14f1b864f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159808 Nov 02 07:31:37.534739 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 157/311] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 02 07:31:37.535986 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ab63b75a-c30c-4c21-9333-ea88694c59f3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:37.548577 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ab63b75a-c30c-4c21-9333-ea88694c59f3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:37.549451 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ab63b75a-c30c-4c21-9333-ea88694c59f3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:37.551000 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ab63b75a-c30c-4c21-9333-ea88694c59f3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:37.552071 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ab63b75a-c30c-4c21-9333-ea88694c59f3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:37.553273 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ab63b75a-c30c-4c21-9333-ea88694c59f3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:37.553982 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ab63b75a-c30c-4c21-9333-ea88694c59f3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:37.618188 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ac25972d-ef78-47fe-882f-b8360a79deef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:37.619786 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-ac25972d-ef78-47fe-882f-b8360a79deef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:37.697387 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ac25972d-ef78-47fe-882f-b8360a79deef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:37.698476 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ac25972d-ef78-47fe-882f-b8360a79deef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:37.707883 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ac25972d-ef78-47fe-882f-b8360a79deef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:37.709325 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ac25972d-ef78-47fe-882f-b8360a79deef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:37.710070 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ac25972d-ef78-47fe-882f-b8360a79deef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:37.712157 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ac25972d-ef78-47fe-882f-b8360a79deef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:38.053022 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ac25972d-ef78-47fe-882f-b8360a79deef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:38.073855 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ac25972d-ef78-47fe-882f-b8360a79deef tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1304 microversion: 2.1 time: 0.459807 Nov 02 07:31:38.090209 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 158/312] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:37 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1304 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:38.508131 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ab63b75a-c30c-4c21-9333-ea88694c59f3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:38.520885 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ab63b75a-c30c-4c21-9333-ea88694c59f3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1313 microversion: 2.1 time: 0.997763 Nov 02 07:31:38.522611 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 155/313] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:37 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1313 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:38.553454 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d9e7f29b-a50d-42e2-89ce-0cb5720fa4b2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:38.554230 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-d9e7f29b-a50d-42e2-89ce-0cb5720fa4b2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:38.581752 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d9e7f29b-a50d-42e2-89ce-0cb5720fa4b2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:38.582861 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d9e7f29b-a50d-42e2-89ce-0cb5720fa4b2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:38.583293 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d9e7f29b-a50d-42e2-89ce-0cb5720fa4b2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:38.584258 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d9e7f29b-a50d-42e2-89ce-0cb5720fa4b2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:38.584711 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d9e7f29b-a50d-42e2-89ce-0cb5720fa4b2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:38.589487 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d9e7f29b-a50d-42e2-89ce-0cb5720fa4b2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:39.097851 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0c0b98da-30b3-447b-93d2-c1daaa5439f8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:39.098933 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-0c0b98da-30b3-447b-93d2-c1daaa5439f8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:39.116087 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0c0b98da-30b3-447b-93d2-c1daaa5439f8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:39.124851 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0c0b98da-30b3-447b-93d2-c1daaa5439f8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:39.125476 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0c0b98da-30b3-447b-93d2-c1daaa5439f8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:39.126242 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0c0b98da-30b3-447b-93d2-c1daaa5439f8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:39.129021 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0c0b98da-30b3-447b-93d2-c1daaa5439f8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:39.130023 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0c0b98da-30b3-447b-93d2-c1daaa5439f8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:39.240040 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d9e7f29b-a50d-42e2-89ce-0cb5720fa4b2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:39.249946 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d9e7f29b-a50d-42e2-89ce-0cb5720fa4b2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:39.252336 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d9e7f29b-a50d-42e2-89ce-0cb5720fa4b2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:39.253748 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d9e7f29b-a50d-42e2-89ce-0cb5720fa4b2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1738 microversion: 2.20 time: 0.704479 Nov 02 07:31:39.268144 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 159/314] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:38 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1738 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:39.320262 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-0c0b98da-30b3-447b-93d2-c1daaa5439f8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:39.330664 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-0c0b98da-30b3-447b-93d2-c1daaa5439f8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1304 microversion: 2.1 time: 0.236639 Nov 02 07:31:39.335615 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 156/315] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:39 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1304 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:39.552183 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-df91ea11-49b9-4380-aa12-d6174ff93fe0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:39.553166 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-df91ea11-49b9-4380-aa12-d6174ff93fe0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:39.563851 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df91ea11-49b9-4380-aa12-d6174ff93fe0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:39.565379 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df91ea11-49b9-4380-aa12-d6174ff93fe0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:39.567452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df91ea11-49b9-4380-aa12-d6174ff93fe0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:39.568989 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df91ea11-49b9-4380-aa12-d6174ff93fe0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:39.572987 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df91ea11-49b9-4380-aa12-d6174ff93fe0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:39.573996 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df91ea11-49b9-4380-aa12-d6174ff93fe0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:40.115019 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-df91ea11-49b9-4380-aa12-d6174ff93fe0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:40.129028 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-df91ea11-49b9-4380-aa12-d6174ff93fe0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1313 microversion: 2.1 time: 0.587799 Nov 02 07:31:40.142728 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 160/316] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:39 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1313 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:40.283536 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-797db5e4-7bc3-4e23-97e6-d86452941c44 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:40.285622 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-797db5e4-7bc3-4e23-97e6-d86452941c44 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:40.297363 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-797db5e4-7bc3-4e23-97e6-d86452941c44 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:40.298127 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-797db5e4-7bc3-4e23-97e6-d86452941c44 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:40.298640 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-797db5e4-7bc3-4e23-97e6-d86452941c44 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:40.299350 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-797db5e4-7bc3-4e23-97e6-d86452941c44 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:40.299957 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-797db5e4-7bc3-4e23-97e6-d86452941c44 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:40.300545 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-797db5e4-7bc3-4e23-97e6-d86452941c44 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:40.365052 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0bca79a9-234c-41d6-8953-ef6feb859910 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:40.366092 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-0bca79a9-234c-41d6-8953-ef6feb859910 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:40.382252 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0bca79a9-234c-41d6-8953-ef6feb859910 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:40.383675 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0bca79a9-234c-41d6-8953-ef6feb859910 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:40.386046 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0bca79a9-234c-41d6-8953-ef6feb859910 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:40.389335 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0bca79a9-234c-41d6-8953-ef6feb859910 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:40.391075 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0bca79a9-234c-41d6-8953-ef6feb859910 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:40.391539 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0bca79a9-234c-41d6-8953-ef6feb859910 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:41.438824 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-797db5e4-7bc3-4e23-97e6-d86452941c44 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:41.460144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-797db5e4-7bc3-4e23-97e6-d86452941c44 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:41.465073 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-797db5e4-7bc3-4e23-97e6-d86452941c44 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:41.471815 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-797db5e4-7bc3-4e23-97e6-d86452941c44 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1738 microversion: 2.20 time: 1.194340 Nov 02 07:31:41.472224 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 157/317] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:40 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1738 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:41.489414 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-cdc69509-3fa7-4d35-b52d-42f6cbf3ee55 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:41.490047 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-cdc69509-3fa7-4d35-b52d-42f6cbf3ee55 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:41.502868 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cdc69509-3fa7-4d35-b52d-42f6cbf3ee55 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:41.503370 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cdc69509-3fa7-4d35-b52d-42f6cbf3ee55 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:41.505158 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cdc69509-3fa7-4d35-b52d-42f6cbf3ee55 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:41.506086 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cdc69509-3fa7-4d35-b52d-42f6cbf3ee55 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:41.506740 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cdc69509-3fa7-4d35-b52d-42f6cbf3ee55 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:41.511915 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cdc69509-3fa7-4d35-b52d-42f6cbf3ee55 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:41.776733 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0bca79a9-234c-41d6-8953-ef6feb859910 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:41.787269 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0bca79a9-234c-41d6-8953-ef6feb859910 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1371 microversion: 2.1 time: 1.433441 Nov 02 07:31:41.788234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 161/318] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:40 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1371 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:41.799166 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-ccf63862-bb44-4d8d-bd26-460dbc323eac req-10c76741-cc8b-4247-bd83-795e8622f3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c89d505-bb4e-469f-bcb9-c336439e865a", "tag": "417309a1-1746-4c69-89dd-ecf6b6199572"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:41.816686 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-ccf63862-bb44-4d8d-bd26-460dbc323eac req-10c76741-cc8b-4247-bd83-795e8622f3b8 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:41.817185 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-ccf63862-bb44-4d8d-bd26-460dbc323eac req-10c76741-cc8b-4247-bd83-795e8622f3b8 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:41.817613 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-ccf63862-bb44-4d8d-bd26-460dbc323eac req-10c76741-cc8b-4247-bd83-795e8622f3b8 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:41.840507 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-ccf63862-bb44-4d8d-bd26-460dbc323eac req-10c76741-cc8b-4247-bd83-795e8622f3b8 service nova] Creating event network-changed:417309a1-1746-4c69-89dd-ecf6b6199572 for instance 4c89d505-bb4e-469f-bcb9-c336439e865a on hv-cinder-80473 Nov 02 07:31:41.855935 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-ccf63862-bb44-4d8d-bd26-460dbc323eac req-10c76741-cc8b-4247-bd83-795e8622f3b8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064301 Nov 02 07:31:41.861456 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 162/319] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:31:42.062463 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-cdc69509-3fa7-4d35-b52d-42f6cbf3ee55 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:42.071213 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-cdc69509-3fa7-4d35-b52d-42f6cbf3ee55 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1497 microversion: 2.1 time: 0.597919 Nov 02 07:31:42.081362 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 158/320] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:41 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1497 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:42.501056 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-379f11d5-8b37-47d7-bb84-4793c15541a6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:42.501763 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-379f11d5-8b37-47d7-bb84-4793c15541a6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:42.511349 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-379f11d5-8b37-47d7-bb84-4793c15541a6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:42.511838 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-379f11d5-8b37-47d7-bb84-4793c15541a6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:42.512274 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-379f11d5-8b37-47d7-bb84-4793c15541a6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:42.512984 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-379f11d5-8b37-47d7-bb84-4793c15541a6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:42.513498 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-379f11d5-8b37-47d7-bb84-4793c15541a6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:42.513924 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-379f11d5-8b37-47d7-bb84-4793c15541a6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:42.812934 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1b90b5c6-802f-4464-afdf-c3113944bca7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:42.813735 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1b90b5c6-802f-4464-afdf-c3113944bca7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:42.829426 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b90b5c6-802f-4464-afdf-c3113944bca7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:42.834209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b90b5c6-802f-4464-afdf-c3113944bca7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:42.835129 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b90b5c6-802f-4464-afdf-c3113944bca7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:42.838435 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b90b5c6-802f-4464-afdf-c3113944bca7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:42.839966 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b90b5c6-802f-4464-afdf-c3113944bca7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:42.840505 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b90b5c6-802f-4464-afdf-c3113944bca7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:43.090997 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-379f11d5-8b37-47d7-bb84-4793c15541a6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:43.107158 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-379f11d5-8b37-47d7-bb84-4793c15541a6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:43.109774 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-379f11d5-8b37-47d7-bb84-4793c15541a6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:43.113735 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-379f11d5-8b37-47d7-bb84-4793c15541a6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1720 microversion: 2.20 time: 0.618817 Nov 02 07:31:43.115107 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 163/321] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:42 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1720 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:43.128598 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-1c77d838-cb1a-43ca-a39e-dc13f53fde1b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:43.131190 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-1c77d838-cb1a-43ca-a39e-dc13f53fde1b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:43.151770 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1c77d838-cb1a-43ca-a39e-dc13f53fde1b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:43.152467 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1c77d838-cb1a-43ca-a39e-dc13f53fde1b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:43.153909 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1c77d838-cb1a-43ca-a39e-dc13f53fde1b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:43.155948 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1c77d838-cb1a-43ca-a39e-dc13f53fde1b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:43.157259 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1c77d838-cb1a-43ca-a39e-dc13f53fde1b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:43.158194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1c77d838-cb1a-43ca-a39e-dc13f53fde1b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:43.203273 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-1c77d838-cb1a-43ca-a39e-dc13f53fde1b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Going to try to terminate instance {{(pid=118991) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:31:43.271474 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:43.324623 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-1c77d838-cb1a-43ca-a39e-dc13f53fde1b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 204 len: 0 microversion: 2.1 time: 0.206773 Nov 02 07:31:43.326638 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 164/322] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:31:43 2022] DELETE /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:31:43.339330 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-da3eeedd-c3f3-43b3-ad1d-d2c654784003 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:43.341048 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-da3eeedd-c3f3-43b3-ad1d-d2c654784003 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:43.349928 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da3eeedd-c3f3-43b3-ad1d-d2c654784003 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:43.352208 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da3eeedd-c3f3-43b3-ad1d-d2c654784003 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:43.352850 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da3eeedd-c3f3-43b3-ad1d-d2c654784003 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:43.353925 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da3eeedd-c3f3-43b3-ad1d-d2c654784003 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:43.354771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da3eeedd-c3f3-43b3-ad1d-d2c654784003 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:43.356268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da3eeedd-c3f3-43b3-ad1d-d2c654784003 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:43.369082 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1b90b5c6-802f-4464-afdf-c3113944bca7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:43.384146 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-1b90b5c6-802f-4464-afdf-c3113944bca7 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1371 microversion: 2.1 time: 0.574801 Nov 02 07:31:43.384948 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 159/323] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:42 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1371 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:43.573563 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-da3eeedd-c3f3-43b3-ad1d-d2c654784003 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:43.582258 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-da3eeedd-c3f3-43b3-ad1d-d2c654784003 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1503 microversion: 2.1 time: 0.250283 Nov 02 07:31:43.584029 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 165/324] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:43 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1503 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:43.977007 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-b7738b12-ca41-4088-98da-949c413256c3 req-c86c5a56-11ed-40b4-a477-bbd3297fff74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f8c1657-4f0c-4856-aa2f-7536a549ad16", "tag": "47c195f9-fe3d-4872-a0a9-ef4120548d09"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:43.988857 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-b7738b12-ca41-4088-98da-949c413256c3 req-c86c5a56-11ed-40b4-a477-bbd3297fff74 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:43.989791 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-b7738b12-ca41-4088-98da-949c413256c3 req-c86c5a56-11ed-40b4-a477-bbd3297fff74 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:43.990518 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-b7738b12-ca41-4088-98da-949c413256c3 req-c86c5a56-11ed-40b4-a477-bbd3297fff74 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:44.006420 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-b7738b12-ca41-4088-98da-949c413256c3 req-c86c5a56-11ed-40b4-a477-bbd3297fff74 service nova] Creating event network-changed:47c195f9-fe3d-4872-a0a9-ef4120548d09 for instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 on hv-cinder-80473 Nov 02 07:31:44.011533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-b7738b12-ca41-4088-98da-949c413256c3 req-c86c5a56-11ed-40b4-a477-bbd3297fff74 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038112 Nov 02 07:31:44.012168 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 160/325] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:31:44.147124 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-bbe004f6-9aa1-46c1-8a96-8aaa758c9f99 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:44.147742 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-bbe004f6-9aa1-46c1-8a96-8aaa758c9f99 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:44.150042 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:44.154774 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bbe004f6-9aa1-46c1-8a96-8aaa758c9f99 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:44.155389 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bbe004f6-9aa1-46c1-8a96-8aaa758c9f99 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:44.155682 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bbe004f6-9aa1-46c1-8a96-8aaa758c9f99 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:44.156392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bbe004f6-9aa1-46c1-8a96-8aaa758c9f99 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:44.156842 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bbe004f6-9aa1-46c1-8a96-8aaa758c9f99 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:44.157797 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bbe004f6-9aa1-46c1-8a96-8aaa758c9f99 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:44.372486 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-bbe004f6-9aa1-46c1-8a96-8aaa758c9f99 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:44.384813 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-bbe004f6-9aa1-46c1-8a96-8aaa758c9f99 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:44.390950 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-bbe004f6-9aa1-46c1-8a96-8aaa758c9f99 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:44.392190 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-bbe004f6-9aa1-46c1-8a96-8aaa758c9f99 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1720 microversion: 2.20 time: 0.249090 Nov 02 07:31:44.392763 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 166/326] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:44 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:44.416477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-8d9f484c-53c0-4b6e-b1d5-eac9df952c60 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:44.417174 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-8d9f484c-53c0-4b6e-b1d5-eac9df952c60 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:44.430504 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8d9f484c-53c0-4b6e-b1d5-eac9df952c60 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:44.431202 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8d9f484c-53c0-4b6e-b1d5-eac9df952c60 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:44.431852 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8d9f484c-53c0-4b6e-b1d5-eac9df952c60 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:44.432633 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8d9f484c-53c0-4b6e-b1d5-eac9df952c60 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:44.433236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8d9f484c-53c0-4b6e-b1d5-eac9df952c60 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:44.433815 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8d9f484c-53c0-4b6e-b1d5-eac9df952c60 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:44.579944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-8d9f484c-53c0-4b6e-b1d5-eac9df952c60 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:44.587710 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-8d9f484c-53c0-4b6e-b1d5-eac9df952c60 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1371 microversion: 2.1 time: 0.182668 Nov 02 07:31:44.588278 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 161/327] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:44 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:44.615418 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2f4f22af-3a00-459f-8e89-b852f2100633 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:44.616371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2f4f22af-3a00-459f-8e89-b852f2100633 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:44.624267 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2f4f22af-3a00-459f-8e89-b852f2100633 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:44.625073 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2f4f22af-3a00-459f-8e89-b852f2100633 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:44.625716 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2f4f22af-3a00-459f-8e89-b852f2100633 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:44.626702 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2f4f22af-3a00-459f-8e89-b852f2100633 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:44.627223 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2f4f22af-3a00-459f-8e89-b852f2100633 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:44.627715 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2f4f22af-3a00-459f-8e89-b852f2100633 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:44.788948 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:44.804138 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2f4f22af-3a00-459f-8e89-b852f2100633 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:44.812394 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2f4f22af-3a00-459f-8e89-b852f2100633 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1503 microversion: 2.1 time: 0.203164 Nov 02 07:31:44.813295 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 167/328] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:44 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:45.260737 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:45.379145 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-184acffe-3a7b-4f64-a399-c6c6d2be1117 req-336227b3-adc7-48dc-80d5-ee9a9d353992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae04f42-6d0d-42e5-ae5f-8022b6f546df", "name": "network-vif-unplugged", "status": "completed", "tag": "ba58ff3d-570b-447a-86ec-a6d9a70152fc"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:45.384192 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=10 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:45.392803 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-184acffe-3a7b-4f64-a399-c6c6d2be1117 req-336227b3-adc7-48dc-80d5-ee9a9d353992 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:45.393517 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-184acffe-3a7b-4f64-a399-c6c6d2be1117 req-336227b3-adc7-48dc-80d5-ee9a9d353992 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:45.394224 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-184acffe-3a7b-4f64-a399-c6c6d2be1117 req-336227b3-adc7-48dc-80d5-ee9a9d353992 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:45.411039 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6e768b61-501c-4b5f-b0bb-fd44d1b375b3 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Action: 'create', calling method: .version_select at 0x7f4d6a3dc8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-399650938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKi+qclSzPpoQvtXUiJsCpq3SZvApjmHmFLVDz42gWhKYD0dcYkiLgNphOUS0YYTQnL2E++uU8TmxoQIAuuVR3Ru5eB4GVrnOY307X1XKCPqxov05zG14NrzUyc/PFCSA=="}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:45.435666 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-184acffe-3a7b-4f64-a399-c6c6d2be1117 req-336227b3-adc7-48dc-80d5-ee9a9d353992 service nova] Creating event network-vif-unplugged:ba58ff3d-570b-447a-86ec-a6d9a70152fc for instance cae04f42-6d0d-42e5-ae5f-8022b6f546df on hv-cinder-80473 Nov 02 07:31:45.441017 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-184acffe-3a7b-4f64-a399-c6c6d2be1117 req-336227b3-adc7-48dc-80d5-ee9a9d353992 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065154 Nov 02 07:31:45.442223 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 168/329] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:31:45.444358 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-6e768b61-501c-4b5f-b0bb-fd44d1b375b3 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Getting quotas for project 82915a36bbdb4b5998fd98833e234ad2. Resources: {'key_pairs'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:31:45.447832 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-502e1743-9200-4258-8166-535c5dd5816c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:45.448529 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-502e1743-9200-4258-8166-535c5dd5816c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:45.449650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-6e768b61-501c-4b5f-b0bb-fd44d1b375b3 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Getting quotas for user 040b847b0db549a2a865deb7be6a8da7 and project 82915a36bbdb4b5998fd98833e234ad2. Resources: {'key_pairs'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:31:45.455449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-502e1743-9200-4258-8166-535c5dd5816c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:45.455935 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-502e1743-9200-4258-8166-535c5dd5816c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:45.456473 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-502e1743-9200-4258-8166-535c5dd5816c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:45.457377 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-502e1743-9200-4258-8166-535c5dd5816c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:45.458034 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-502e1743-9200-4258-8166-535c5dd5816c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:45.459258 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-502e1743-9200-4258-8166-535c5dd5816c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:45.476881 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-6e768b61-501c-4b5f-b0bb-fd44d1b375b3 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.249761 Nov 02 07:31:45.477584 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 162/330] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 07:31:45 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:31:45.612915 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-bcbd2f73-77db-4933-a6da-73250eeb2562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:45.613553 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-bcbd2f73-77db-4933-a6da-73250eeb2562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:45.615874 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:45.625512 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bcbd2f73-77db-4933-a6da-73250eeb2562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:45.625697 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bcbd2f73-77db-4933-a6da-73250eeb2562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:45.626321 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bcbd2f73-77db-4933-a6da-73250eeb2562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:45.627424 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bcbd2f73-77db-4933-a6da-73250eeb2562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:45.628210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bcbd2f73-77db-4933-a6da-73250eeb2562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:45.629028 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bcbd2f73-77db-4933-a6da-73250eeb2562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:45.653639 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-502e1743-9200-4258-8166-535c5dd5816c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:45.674168 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-502e1743-9200-4258-8166-535c5dd5816c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:45.679603 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-502e1743-9200-4258-8166-535c5dd5816c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:45.681073 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-502e1743-9200-4258-8166-535c5dd5816c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1720 microversion: 2.20 time: 0.237714 Nov 02 07:31:45.693340 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=100 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:45.698913 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 169/331] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:45 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1720 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:45.836091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8b973fc9-ca93-435c-b39b-799e77a688dd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:45.837286 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8b973fc9-ca93-435c-b39b-799e77a688dd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:45.844706 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b973fc9-ca93-435c-b39b-799e77a688dd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:45.845538 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b973fc9-ca93-435c-b39b-799e77a688dd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:45.846204 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b973fc9-ca93-435c-b39b-799e77a688dd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:45.847156 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b973fc9-ca93-435c-b39b-799e77a688dd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:45.847823 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b973fc9-ca93-435c-b39b-799e77a688dd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:45.848455 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8b973fc9-ca93-435c-b39b-799e77a688dd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:45.854444 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-bcbd2f73-77db-4933-a6da-73250eeb2562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:45.864316 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-bcbd2f73-77db-4933-a6da-73250eeb2562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1371 microversion: 2.1 time: 0.256869 Nov 02 07:31:45.874427 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 163/332] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:45 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1371 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:46.006583 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8b973fc9-ca93-435c-b39b-799e77a688dd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:46.015777 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8b973fc9-ca93-435c-b39b-799e77a688dd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1503 microversion: 2.1 time: 0.183509 Nov 02 07:31:46.016358 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 170/333] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:45 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:46.713286 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-952208e8-95e3-4087-aa13-91b291fa3663 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:46.714893 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-952208e8-95e3-4087-aa13-91b291fa3663 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:46.727590 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-952208e8-95e3-4087-aa13-91b291fa3663 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:46.733434 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-952208e8-95e3-4087-aa13-91b291fa3663 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:46.733879 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-952208e8-95e3-4087-aa13-91b291fa3663 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:46.734835 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-952208e8-95e3-4087-aa13-91b291fa3663 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:46.735358 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-952208e8-95e3-4087-aa13-91b291fa3663 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:46.735845 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-952208e8-95e3-4087-aa13-91b291fa3663 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:46.889990 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-4432aebd-71fe-41c2-b8ab-1ce51676f2fe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:46.891950 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-4432aebd-71fe-41c2-b8ab-1ce51676f2fe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:46.898927 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4432aebd-71fe-41c2-b8ab-1ce51676f2fe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:46.899722 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4432aebd-71fe-41c2-b8ab-1ce51676f2fe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:46.900316 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4432aebd-71fe-41c2-b8ab-1ce51676f2fe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:46.901207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4432aebd-71fe-41c2-b8ab-1ce51676f2fe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:46.901864 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4432aebd-71fe-41c2-b8ab-1ce51676f2fe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:46.902459 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4432aebd-71fe-41c2-b8ab-1ce51676f2fe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:47.141057 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-952208e8-95e3-4087-aa13-91b291fa3663 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:47.155252 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-952208e8-95e3-4087-aa13-91b291fa3663 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:47.156934 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-952208e8-95e3-4087-aa13-91b291fa3663 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:47.157968 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-952208e8-95e3-4087-aa13-91b291fa3663 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1720 microversion: 2.20 time: 0.450295 Nov 02 07:31:47.161117 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 164/334] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:46 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1720 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:47.166063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-79acb0ec-9733-4ef6-a33a-95e698a2387a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:47.172584 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-79acb0ec-9733-4ef6-a33a-95e698a2387a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:47.189547 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-79acb0ec-9733-4ef6-a33a-95e698a2387a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:47.190220 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-79acb0ec-9733-4ef6-a33a-95e698a2387a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:47.190961 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-79acb0ec-9733-4ef6-a33a-95e698a2387a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:47.191670 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-79acb0ec-9733-4ef6-a33a-95e698a2387a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:47.192128 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-79acb0ec-9733-4ef6-a33a-95e698a2387a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:47.192552 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-79acb0ec-9733-4ef6-a33a-95e698a2387a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:47.277107 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-4432aebd-71fe-41c2-b8ab-1ce51676f2fe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:47.290529 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-4432aebd-71fe-41c2-b8ab-1ce51676f2fe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1371 microversion: 2.1 time: 0.405162 Nov 02 07:31:47.291518 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 171/335] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:46 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1371 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:47.524389 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-79acb0ec-9733-4ef6-a33a-95e698a2387a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:47.537128 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-79acb0ec-9733-4ef6-a33a-95e698a2387a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1503 microversion: 2.1 time: 0.374619 Nov 02 07:31:47.541214 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 165/336] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:47 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1503 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:47.738893 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-6a07ddfa-4fe5-4f55-8225-73bb358d16f2 req-1cfd3b62-5a32-409b-bd86-d5030ca3fcb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b5c7853-1758-4e70-86c7-5f1bfd998ca6", "name": "network-vif-deleted", "tag": "1fbf5f86-26a9-44e9-866d-6515a0736725"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:47.749110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-6a07ddfa-4fe5-4f55-8225-73bb358d16f2 req-1cfd3b62-5a32-409b-bd86-d5030ca3fcb3 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:47.749580 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-6a07ddfa-4fe5-4f55-8225-73bb358d16f2 req-1cfd3b62-5a32-409b-bd86-d5030ca3fcb3 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:47.750004 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-6a07ddfa-4fe5-4f55-8225-73bb358d16f2 req-1cfd3b62-5a32-409b-bd86-d5030ca3fcb3 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:47.761641 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-6a07ddfa-4fe5-4f55-8225-73bb358d16f2 req-1cfd3b62-5a32-409b-bd86-d5030ca3fcb3 service nova] Creating event network-vif-deleted:1fbf5f86-26a9-44e9-866d-6515a0736725 for instance 2b5c7853-1758-4e70-86c7-5f1bfd998ca6 on hv-cinder-80473 Nov 02 07:31:47.766975 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-6a07ddfa-4fe5-4f55-8225-73bb358d16f2 req-1cfd3b62-5a32-409b-bd86-d5030ca3fcb3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031673 Nov 02 07:31:47.767763 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 172/337] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:31:48.188555 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-80e622cc-70ee-4bed-a4aa-aab19e6bdb78 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:48.189198 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-80e622cc-70ee-4bed-a4aa-aab19e6bdb78 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:48.196800 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-80e622cc-70ee-4bed-a4aa-aab19e6bdb78 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:48.197292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-80e622cc-70ee-4bed-a4aa-aab19e6bdb78 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:48.197804 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-80e622cc-70ee-4bed-a4aa-aab19e6bdb78 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:48.198565 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-80e622cc-70ee-4bed-a4aa-aab19e6bdb78 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:48.199015 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-80e622cc-70ee-4bed-a4aa-aab19e6bdb78 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:48.199701 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-80e622cc-70ee-4bed-a4aa-aab19e6bdb78 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:48.318081 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-7f802ab0-e83b-42c5-aec5-1d7116437015 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:48.318811 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-7f802ab0-e83b-42c5-aec5-1d7116437015 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:48.325372 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7f802ab0-e83b-42c5-aec5-1d7116437015 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:48.325926 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7f802ab0-e83b-42c5-aec5-1d7116437015 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:48.326992 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7f802ab0-e83b-42c5-aec5-1d7116437015 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:48.327698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7f802ab0-e83b-42c5-aec5-1d7116437015 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:48.328157 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7f802ab0-e83b-42c5-aec5-1d7116437015 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:48.328583 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7f802ab0-e83b-42c5-aec5-1d7116437015 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:48.364604 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-80e622cc-70ee-4bed-a4aa-aab19e6bdb78 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:48.374349 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-80e622cc-70ee-4bed-a4aa-aab19e6bdb78 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:48.375943 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-80e622cc-70ee-4bed-a4aa-aab19e6bdb78 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:48.377240 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-80e622cc-70ee-4bed-a4aa-aab19e6bdb78 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1663 microversion: 2.20 time: 0.193062 Nov 02 07:31:48.377885 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 166/338] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:48 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1663 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:48.404596 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0b30c54b-fad2-4ca6-84fc-1532ff8085c7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "572d9390-3818-4c95-a441-176885163883"}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:48.407479 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-0b30c54b-fad2-4ca6-84fc-1532ff8085c7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:48.413928 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0b30c54b-fad2-4ca6-84fc-1532ff8085c7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:48.414715 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0b30c54b-fad2-4ca6-84fc-1532ff8085c7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:48.415147 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0b30c54b-fad2-4ca6-84fc-1532ff8085c7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:48.415843 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0b30c54b-fad2-4ca6-84fc-1532ff8085c7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:48.416291 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0b30c54b-fad2-4ca6-84fc-1532ff8085c7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:48.416705 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0b30c54b-fad2-4ca6-84fc-1532ff8085c7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:48.488182 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7f802ab0-e83b-42c5-aec5-1d7116437015 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:48.497046 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-7f802ab0-e83b-42c5-aec5-1d7116437015 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1371 microversion: 2.1 time: 0.183054 Nov 02 07:31:48.497511 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 173/339] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:48 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:48.570777 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-eccba0e3-85f0-4331-a25c-6636a9ead7cf tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:48.571635 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-eccba0e3-85f0-4331-a25c-6636a9ead7cf tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:48.580835 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eccba0e3-85f0-4331-a25c-6636a9ead7cf tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:48.582703 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eccba0e3-85f0-4331-a25c-6636a9ead7cf tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:48.583184 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eccba0e3-85f0-4331-a25c-6636a9ead7cf tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:48.584041 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eccba0e3-85f0-4331-a25c-6636a9ead7cf tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:48.584500 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eccba0e3-85f0-4331-a25c-6636a9ead7cf tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:48.584775 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eccba0e3-85f0-4331-a25c-6636a9ead7cf tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:48.618172 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eccba0e3-85f0-4331-a25c-6636a9ead7cf tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:48.618710 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eccba0e3-85f0-4331-a25c-6636a9ead7cf tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:48.619123 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eccba0e3-85f0-4331-a25c-6636a9ead7cf tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:48.619560 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.objects.instance [None req-eccba0e3-85f0-4331-a25c-6636a9ead7cf tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lazy-loading 'fault' on Instance uuid 2b5c7853-1758-4e70-86c7-5f1bfd998ca6 {{(pid=118991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:31:48.671782 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-eccba0e3-85f0-4331-a25c-6636a9ead7cf tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:48.684675 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-eccba0e3-85f0-4331-a25c-6636a9ead7cf tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 200 len: 1303 microversion: 2.1 time: 0.117804 Nov 02 07:31:48.690142 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 174/340] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:48 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:48.755302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-0b30c54b-fad2-4ca6-84fc-1532ff8085c7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "POST /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.356199 Nov 02 07:31:48.755910 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 167/341] 10.222.0.18 () {62 vars in 1364 bytes} [Wed Nov 2 07:31:48 2022] POST /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/os-volume_attachments => generated 188 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 07:31:48.891532 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-7e74b40f-5279-4951-a310-67a0c3686999 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:48.892416 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-7e74b40f-5279-4951-a310-67a0c3686999 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:48.898560 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7e74b40f-5279-4951-a310-67a0c3686999 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:48.899064 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7e74b40f-5279-4951-a310-67a0c3686999 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:48.899711 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7e74b40f-5279-4951-a310-67a0c3686999 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:48.900404 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7e74b40f-5279-4951-a310-67a0c3686999 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:48.900878 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7e74b40f-5279-4951-a310-67a0c3686999 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:48.901320 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7e74b40f-5279-4951-a310-67a0c3686999 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:48.949297 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-7e74b40f-5279-4951-a310-67a0c3686999 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118991) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 07:31:49.023574 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-7e74b40f-5279-4951-a310-67a0c3686999 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "POST /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/action" status: 202 len: 0 microversion: 2.20 time: 0.137837 Nov 02 07:31:49.024094 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 175/342] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 07:31:48 2022] POST /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:31:49.032863 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2b1fa5e0-10f1-42c4-907b-5d1aa7303728 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:49.033621 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-2b1fa5e0-10f1-42c4-907b-5d1aa7303728 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:49.044800 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b1fa5e0-10f1-42c4-907b-5d1aa7303728 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:49.045512 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b1fa5e0-10f1-42c4-907b-5d1aa7303728 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:49.046047 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b1fa5e0-10f1-42c4-907b-5d1aa7303728 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:49.047014 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b1fa5e0-10f1-42c4-907b-5d1aa7303728 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:49.047467 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b1fa5e0-10f1-42c4-907b-5d1aa7303728 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:49.047891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b1fa5e0-10f1-42c4-907b-5d1aa7303728 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:49.230134 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2b1fa5e0-10f1-42c4-907b-5d1aa7303728 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:49.264865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2b1fa5e0-10f1-42c4-907b-5d1aa7303728 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:49.266799 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2b1fa5e0-10f1-42c4-907b-5d1aa7303728 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:49.268130 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-2b1fa5e0-10f1-42c4-907b-5d1aa7303728 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1749 microversion: 2.20 time: 0.239736 Nov 02 07:31:49.288501 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 168/343] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:49 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1749 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:49.530054 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f6b1a663-cf27-4a7e-8181-8a3fc4cf17f1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:49.530754 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f6b1a663-cf27-4a7e-8181-8a3fc4cf17f1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:49.537285 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6b1a663-cf27-4a7e-8181-8a3fc4cf17f1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:49.538424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6b1a663-cf27-4a7e-8181-8a3fc4cf17f1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:49.539016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6b1a663-cf27-4a7e-8181-8a3fc4cf17f1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:49.540011 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6b1a663-cf27-4a7e-8181-8a3fc4cf17f1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:49.540616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6b1a663-cf27-4a7e-8181-8a3fc4cf17f1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:49.541247 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6b1a663-cf27-4a7e-8181-8a3fc4cf17f1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:49.711067 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-b8350204-101a-480f-9698-215405d43032 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:49.711667 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-b8350204-101a-480f-9698-215405d43032 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 2b5c7853-1758-4e70-86c7-5f1bfd998ca6] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:49.719970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f6b1a663-cf27-4a7e-8181-8a3fc4cf17f1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:49.722801 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b8350204-101a-480f-9698-215405d43032 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:49.723349 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b8350204-101a-480f-9698-215405d43032 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:49.723784 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b8350204-101a-480f-9698-215405d43032 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:49.724478 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b8350204-101a-480f-9698-215405d43032 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:49.724922 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b8350204-101a-480f-9698-215405d43032 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:49.725336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b8350204-101a-480f-9698-215405d43032 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:49.734318 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f6b1a663-cf27-4a7e-8181-8a3fc4cf17f1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1371 microversion: 2.1 time: 0.215177 Nov 02 07:31:49.748569 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 176/344] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:49 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:49.766778 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-b8350204-101a-480f-9698-215405d43032 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] HTTP exception thrown: Instance 2b5c7853-1758-4e70-86c7-5f1bfd998ca6 could not be found. Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-b8350204-101a-480f-9698-215405d43032 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Request method failure captured: Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 HTTP/1.1 Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhzDFVNrRsipe4hVl3zTVPXXvVM8yerROqByxQorQ18wf-0EFpR3qWcmGF0K1j3BeqG_ThkAICcMHMu_jaop5hL-Bl1J8qFSCQqM1FJGtlT0UF1F9jrTaaalFzykuf3kUVi5Gj9hVpT_mqiCUlUIB-ewLE_OMYrFGdWGD6o_ra2A0ug Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: 155356fb94b74eaba3a8465d1a1f21ff Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-VolumesActionsTest-994650783 Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:31:49.768568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:31:49.770144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_155356fb94b74eaba3a8465d1a1f21ff", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/155356fb94b74eaba3a8465d1a1f21ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/155356fb94b74eaba3a8465d1a1f21ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/155356fb94b74eaba3a8465d1a1f21ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:31:49.770144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-VolumesActionsTest-994650783 Nov 02 07:31:49.770144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: 155356fb94b74eaba3a8465d1a1f21ff Nov 02 07:31:49.770144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-VolumesActionsTest-994650783 Nov 02 07:31:49.770144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-VolumesActionsTest-994650783-project Nov 02 07:31:49.770144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:31:49.770144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:31:49.770144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 0b55941561934c818a2b5eb2c9a19d22 Nov 02 07:31:49.770144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-VolumesActionsTest-994650783-project Nov 02 07:31:49.770144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:31:49.770144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 2b5c7853-1758-4e70-86c7-5f1bfd998ca6 could not be found. Nov 02 07:31:49.770144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '2b5c7853-1758-4e70-86c7-5f1bfd998ca6'} Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b5c7853-1758-4e70-86c7-5f1bfd998ca6 could not be found. Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:31:49.777279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b5c7853-1758-4e70-86c7-5f1bfd998ca6 could not be found. Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b5c7853-1758-4e70-86c7-5f1bfd998ca6 could not be found. Nov 02 07:31:49.778570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:31:49.779776 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-b8350204-101a-480f-9698-215405d43032 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Returning 404 to user: Instance 2b5c7853-1758-4e70-86c7-5f1bfd998ca6 could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:31:49.779776 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-b8350204-101a-480f-9698-215405d43032 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6" status: 404 len: 111 microversion: 2.1 time: 0.062730 Nov 02 07:31:49.779776 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 169/345] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:49 2022] GET /compute/v2.1/servers/2b5c7853-1758-4e70-86c7-5f1bfd998ca6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 07:31:49.880987 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2034801997", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452", "networks": [{"uuid": "3fafd9c5-3180-43ff-9a2d-50cffbbda74e"}]}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:49.939673 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.network.neutron [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] validate_networks() for [('3fafd9c5-3180-43ff-9a2d-50cffbbda74e', None, None, None, None, None)] {{(pid=118991) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:31:50.299247 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-cc5a8791-d78a-4cd3-a17f-89065585140b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:50.300905 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-cc5a8791-d78a-4cd3-a17f-89065585140b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:50.308798 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Flavor limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:31:50.309215 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Image limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:31:50.309806 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Flavor pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:31:50.310944 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Image pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:31:50.311715 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:31:50.313496 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cc5a8791-d78a-4cd3-a17f-89065585140b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:50.314003 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cc5a8791-d78a-4cd3-a17f-89065585140b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:50.314554 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cc5a8791-d78a-4cd3-a17f-89065585140b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:50.315324 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cc5a8791-d78a-4cd3-a17f-89065585140b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:50.315772 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cc5a8791-d78a-4cd3-a17f-89065585140b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:50.316268 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cc5a8791-d78a-4cd3-a17f-89065585140b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:50.325198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:50.325732 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:50.326822 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:50.327741 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:50.328354 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:50.328919 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:50.352194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Getting quotas for project 155356fb94b74eaba3a8465d1a1f21ff. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:31:50.356208 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Getting quotas for user 0b55941561934c818a2b5eb2c9a19d22 and project 155356fb94b74eaba3a8465d1a1f21ff. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:31:50.367293 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Going to run 1 instances... {{(pid=118991) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:31:50.369595 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:31:50.429973 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-27357436-e9f1-493f-895a-0ca7a0807cbb tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553293 Nov 02 07:31:50.431211 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 177/346] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:31:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 07:31:50.450462 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-3795e4cc-f668-4039-be3e-55fa6d1567fd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:50.451618 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-3795e4cc-f668-4039-be3e-55fa6d1567fd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:50.546631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-3795e4cc-f668-4039-be3e-55fa6d1567fd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:50.556202 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-3795e4cc-f668-4039-be3e-55fa6d1567fd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1214 microversion: 2.1 time: 0.115652 Nov 02 07:31:50.556838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-cc5a8791-d78a-4cd3-a17f-89065585140b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:50.557480 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 178/347] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:50 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:50.571848 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-cc5a8791-d78a-4cd3-a17f-89065585140b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:50.573977 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-cc5a8791-d78a-4cd3-a17f-89065585140b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:50.575482 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-cc5a8791-d78a-4cd3-a17f-89065585140b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1751 microversion: 2.20 time: 0.281020 Nov 02 07:31:50.578114 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 170/348] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:50 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1751 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:31:50.771045 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-3907c5b8-3893-42a4-9aa0-1df15091a9d6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:50.771874 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-3907c5b8-3893-42a4-9aa0-1df15091a9d6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:50.780553 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3907c5b8-3893-42a4-9aa0-1df15091a9d6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:50.784476 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3907c5b8-3893-42a4-9aa0-1df15091a9d6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:50.784912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3907c5b8-3893-42a4-9aa0-1df15091a9d6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:50.785652 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3907c5b8-3893-42a4-9aa0-1df15091a9d6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:50.786117 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3907c5b8-3893-42a4-9aa0-1df15091a9d6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:50.786739 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3907c5b8-3893-42a4-9aa0-1df15091a9d6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:50.937149 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-3907c5b8-3893-42a4-9aa0-1df15091a9d6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:50.945977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-3907c5b8-3893-42a4-9aa0-1df15091a9d6 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1371 microversion: 2.1 time: 0.178917 Nov 02 07:31:50.946571 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 179/349] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:50 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:51.580078 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3ae86390-71dd-4f4d-b916-9f169d5845a3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:51.580718 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3ae86390-71dd-4f4d-b916-9f169d5845a3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:51.587010 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3ae86390-71dd-4f4d-b916-9f169d5845a3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:51.587498 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3ae86390-71dd-4f4d-b916-9f169d5845a3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:51.587930 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3ae86390-71dd-4f4d-b916-9f169d5845a3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:51.588628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3ae86390-71dd-4f4d-b916-9f169d5845a3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:51.589140 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3ae86390-71dd-4f4d-b916-9f169d5845a3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:51.589576 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3ae86390-71dd-4f4d-b916-9f169d5845a3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:51.607154 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a8483f3a-e25d-4f85-865a-6db53c9e42a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:51.607856 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a8483f3a-e25d-4f85-865a-6db53c9e42a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:51.613982 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8483f3a-e25d-4f85-865a-6db53c9e42a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:51.614499 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8483f3a-e25d-4f85-865a-6db53c9e42a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:51.614931 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8483f3a-e25d-4f85-865a-6db53c9e42a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:51.615617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8483f3a-e25d-4f85-865a-6db53c9e42a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:51.616065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8483f3a-e25d-4f85-865a-6db53c9e42a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:51.616486 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8483f3a-e25d-4f85-865a-6db53c9e42a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:51.658647 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3ae86390-71dd-4f4d-b916-9f169d5845a3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:51.666942 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3ae86390-71dd-4f4d-b916-9f169d5845a3 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1266 microversion: 2.1 time: 0.092086 Nov 02 07:31:51.667596 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 171/350] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:51 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:51.757688 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a8483f3a-e25d-4f85-865a-6db53c9e42a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:51.767248 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a8483f3a-e25d-4f85-865a-6db53c9e42a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:51.768663 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a8483f3a-e25d-4f85-865a-6db53c9e42a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:51.769804 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a8483f3a-e25d-4f85-865a-6db53c9e42a0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1751 microversion: 2.20 time: 0.166626 Nov 02 07:31:51.770353 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 180/351] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:51 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:31:51.969744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-24952b5d-ccc0-4ba6-87d8-cfad13b29fb4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:51.970346 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-24952b5d-ccc0-4ba6-87d8-cfad13b29fb4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:51.976238 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-24952b5d-ccc0-4ba6-87d8-cfad13b29fb4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:51.976720 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-24952b5d-ccc0-4ba6-87d8-cfad13b29fb4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:51.977148 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-24952b5d-ccc0-4ba6-87d8-cfad13b29fb4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:51.977834 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-24952b5d-ccc0-4ba6-87d8-cfad13b29fb4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:51.978281 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-24952b5d-ccc0-4ba6-87d8-cfad13b29fb4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:51.978724 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-24952b5d-ccc0-4ba6-87d8-cfad13b29fb4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:52.169244 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-24952b5d-ccc0-4ba6-87d8-cfad13b29fb4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:52.177275 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-24952b5d-ccc0-4ba6-87d8-cfad13b29fb4 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1371 microversion: 2.1 time: 0.212107 Nov 02 07:31:52.177923 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 172/352] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:51 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:52.690821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2cb7daa7-fcee-49aa-86e9-6ef5cf83a2e8 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:52.691406 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2cb7daa7-fcee-49aa-86e9-6ef5cf83a2e8 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:52.697910 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2cb7daa7-fcee-49aa-86e9-6ef5cf83a2e8 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:52.698459 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2cb7daa7-fcee-49aa-86e9-6ef5cf83a2e8 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:52.699046 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2cb7daa7-fcee-49aa-86e9-6ef5cf83a2e8 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:52.699741 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2cb7daa7-fcee-49aa-86e9-6ef5cf83a2e8 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:52.700194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2cb7daa7-fcee-49aa-86e9-6ef5cf83a2e8 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:52.700614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2cb7daa7-fcee-49aa-86e9-6ef5cf83a2e8 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:52.797714 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-637d874c-028e-48f9-bcb3-483d3b888ea3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:52.798712 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2cb7daa7-fcee-49aa-86e9-6ef5cf83a2e8 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:52.799479 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-637d874c-028e-48f9-bcb3-483d3b888ea3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:52.806409 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-637d874c-028e-48f9-bcb3-483d3b888ea3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:52.806605 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2cb7daa7-fcee-49aa-86e9-6ef5cf83a2e8 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1272 microversion: 2.1 time: 0.119624 Nov 02 07:31:52.807098 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 181/353] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:52 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:52.807551 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-637d874c-028e-48f9-bcb3-483d3b888ea3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:52.808318 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-637d874c-028e-48f9-bcb3-483d3b888ea3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:52.809225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-637d874c-028e-48f9-bcb3-483d3b888ea3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:52.809752 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-637d874c-028e-48f9-bcb3-483d3b888ea3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:52.811471 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-637d874c-028e-48f9-bcb3-483d3b888ea3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:53.006550 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-637d874c-028e-48f9-bcb3-483d3b888ea3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:53.016891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-637d874c-028e-48f9-bcb3-483d3b888ea3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:53.018339 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-637d874c-028e-48f9-bcb3-483d3b888ea3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:53.019870 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-637d874c-028e-48f9-bcb3-483d3b888ea3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.227218 Nov 02 07:31:53.020427 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 173/354] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:52 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:53.199740 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ca24efe1-2db3-489d-912b-e52343c36203 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:53.200360 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-ca24efe1-2db3-489d-912b-e52343c36203 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:53.207078 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ca24efe1-2db3-489d-912b-e52343c36203 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:53.207989 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ca24efe1-2db3-489d-912b-e52343c36203 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:53.208584 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ca24efe1-2db3-489d-912b-e52343c36203 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:53.209461 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ca24efe1-2db3-489d-912b-e52343c36203 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:53.210062 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ca24efe1-2db3-489d-912b-e52343c36203 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:53.210677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ca24efe1-2db3-489d-912b-e52343c36203 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:53.252707 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-5b5e9427-2210-4017-afc4-56b72f70f40e req-824a8b29-9dc3-4e28-91a5-47ede9958a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8c1657-4f0c-4856-aa2f-7536a549ad16", "name": "network-vif-plugged", "status": "completed", "tag": "47c195f9-fe3d-4872-a0a9-ef4120548d09"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:53.262874 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-5b5e9427-2210-4017-afc4-56b72f70f40e req-824a8b29-9dc3-4e28-91a5-47ede9958a2e service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:53.265175 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-5b5e9427-2210-4017-afc4-56b72f70f40e req-824a8b29-9dc3-4e28-91a5-47ede9958a2e service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:53.265835 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-5b5e9427-2210-4017-afc4-56b72f70f40e req-824a8b29-9dc3-4e28-91a5-47ede9958a2e service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:53.280223 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-5b5e9427-2210-4017-afc4-56b72f70f40e req-824a8b29-9dc3-4e28-91a5-47ede9958a2e service nova] Creating event network-vif-plugged:47c195f9-fe3d-4872-a0a9-ef4120548d09 for instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 on hv-cinder-80473 Nov 02 07:31:53.290943 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-5b5e9427-2210-4017-afc4-56b72f70f40e req-824a8b29-9dc3-4e28-91a5-47ede9958a2e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043551 Nov 02 07:31:53.292773 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 174/355] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:31:53.511523 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ca24efe1-2db3-489d-912b-e52343c36203 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:53.516124 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:53.523318 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ca24efe1-2db3-489d-912b-e52343c36203 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1371 microversion: 2.1 time: 0.327479 Nov 02 07:31:53.524427 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 182/356] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:53 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1371 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:53.833471 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7c352019-2a39-474b-acaa-a95ed3983b4b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:53.835287 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-7c352019-2a39-474b-acaa-a95ed3983b4b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:53.843198 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7c352019-2a39-474b-acaa-a95ed3983b4b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:53.843783 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7c352019-2a39-474b-acaa-a95ed3983b4b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:53.844222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7c352019-2a39-474b-acaa-a95ed3983b4b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:53.844917 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7c352019-2a39-474b-acaa-a95ed3983b4b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:53.845387 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7c352019-2a39-474b-acaa-a95ed3983b4b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:53.845804 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7c352019-2a39-474b-acaa-a95ed3983b4b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:54.008805 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-87e355a7-6187-41a9-9c51-a864b608dc6e req-582ea465-7477-494f-8eb5-9c0050adcb76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6e52cf-5d29-406e-bb70-9e84ec9f0bec", "tag": "566880a6-3eba-41de-a814-40ba52af43d4"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:54.020452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-87e355a7-6187-41a9-9c51-a864b608dc6e req-582ea465-7477-494f-8eb5-9c0050adcb76 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:54.020980 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-87e355a7-6187-41a9-9c51-a864b608dc6e req-582ea465-7477-494f-8eb5-9c0050adcb76 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:54.021402 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-87e355a7-6187-41a9-9c51-a864b608dc6e req-582ea465-7477-494f-8eb5-9c0050adcb76 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:54.034174 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-87e355a7-6187-41a9-9c51-a864b608dc6e req-582ea465-7477-494f-8eb5-9c0050adcb76 service nova] Creating event network-changed:566880a6-3eba-41de-a814-40ba52af43d4 for instance 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec on hv-cinder-80473 Nov 02 07:31:54.039656 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-87e355a7-6187-41a9-9c51-a864b608dc6e req-582ea465-7477-494f-8eb5-9c0050adcb76 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034537 Nov 02 07:31:54.040247 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 183/357] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:31:54.046388 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-bda81e72-cf41-4c2a-b136-d083cb7bd2b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:54.047161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-bda81e72-cf41-4c2a-b136-d083cb7bd2b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:54.054036 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bda81e72-cf41-4c2a-b136-d083cb7bd2b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:54.054546 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bda81e72-cf41-4c2a-b136-d083cb7bd2b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:54.054976 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bda81e72-cf41-4c2a-b136-d083cb7bd2b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:54.055675 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bda81e72-cf41-4c2a-b136-d083cb7bd2b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:54.056112 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bda81e72-cf41-4c2a-b136-d083cb7bd2b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:54.056534 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bda81e72-cf41-4c2a-b136-d083cb7bd2b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:54.065518 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-7c352019-2a39-474b-acaa-a95ed3983b4b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:54.082945 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-7c352019-2a39-474b-acaa-a95ed3983b4b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.255089 Nov 02 07:31:54.083527 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 175/358] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:53 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:54.203654 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-bda81e72-cf41-4c2a-b136-d083cb7bd2b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:54.212414 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-bda81e72-cf41-4c2a-b136-d083cb7bd2b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:54.214032 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-bda81e72-cf41-4c2a-b136-d083cb7bd2b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:54.215458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-bda81e72-cf41-4c2a-b136-d083cb7bd2b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.174066 Nov 02 07:31:54.216768 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 184/359] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:54 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:54.547709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e336ac7f-e798-44b9-bed3-69e84c48230b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:54.548316 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e336ac7f-e798-44b9-bed3-69e84c48230b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:54.554348 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e336ac7f-e798-44b9-bed3-69e84c48230b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:54.554857 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e336ac7f-e798-44b9-bed3-69e84c48230b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:54.555290 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e336ac7f-e798-44b9-bed3-69e84c48230b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:54.555973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e336ac7f-e798-44b9-bed3-69e84c48230b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:54.556429 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e336ac7f-e798-44b9-bed3-69e84c48230b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:54.556843 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e336ac7f-e798-44b9-bed3-69e84c48230b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:54.729372 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-e336ac7f-e798-44b9-bed3-69e84c48230b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:54.737251 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e336ac7f-e798-44b9-bed3-69e84c48230b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1371 microversion: 2.1 time: 0.193578 Nov 02 07:31:54.738150 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 176/360] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:54 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:55.108331 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0dc9b185-c033-4f8c-8b46-c51531c34472 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:55.109932 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-0dc9b185-c033-4f8c-8b46-c51531c34472 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:55.117062 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0dc9b185-c033-4f8c-8b46-c51531c34472 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:55.117552 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0dc9b185-c033-4f8c-8b46-c51531c34472 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:55.118351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0dc9b185-c033-4f8c-8b46-c51531c34472 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:55.119080 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0dc9b185-c033-4f8c-8b46-c51531c34472 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:55.119526 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0dc9b185-c033-4f8c-8b46-c51531c34472 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:55.119943 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0dc9b185-c033-4f8c-8b46-c51531c34472 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:55.241672 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9f05769f-b06a-4db7-b330-fdd308c30c8d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:55.242264 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9f05769f-b06a-4db7-b330-fdd308c30c8d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:55.249814 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f05769f-b06a-4db7-b330-fdd308c30c8d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:55.250308 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f05769f-b06a-4db7-b330-fdd308c30c8d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:55.250778 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f05769f-b06a-4db7-b330-fdd308c30c8d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:55.251480 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f05769f-b06a-4db7-b330-fdd308c30c8d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:55.252071 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f05769f-b06a-4db7-b330-fdd308c30c8d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:55.252493 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f05769f-b06a-4db7-b330-fdd308c30c8d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:55.274861 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0dc9b185-c033-4f8c-8b46-c51531c34472 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:55.287140 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0dc9b185-c033-4f8c-8b46-c51531c34472 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.183536 Nov 02 07:31:55.287715 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 185/361] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:55 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:55.425811 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9f05769f-b06a-4db7-b330-fdd308c30c8d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:55.434924 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9f05769f-b06a-4db7-b330-fdd308c30c8d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:55.436439 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9f05769f-b06a-4db7-b330-fdd308c30c8d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:55.437619 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9f05769f-b06a-4db7-b330-fdd308c30c8d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.200396 Nov 02 07:31:55.438187 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 177/362] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:55 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:31:55.761382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ad2185bd-d015-4ecd-acc8-ca3e6a337071 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:55.762168 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-ad2185bd-d015-4ecd-acc8-ca3e6a337071 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:55.769719 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ad2185bd-d015-4ecd-acc8-ca3e6a337071 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:55.770306 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ad2185bd-d015-4ecd-acc8-ca3e6a337071 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:55.770830 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ad2185bd-d015-4ecd-acc8-ca3e6a337071 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:55.771704 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ad2185bd-d015-4ecd-acc8-ca3e6a337071 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:55.772457 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ad2185bd-d015-4ecd-acc8-ca3e6a337071 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:55.772941 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ad2185bd-d015-4ecd-acc8-ca3e6a337071 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:55.921997 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ad2185bd-d015-4ecd-acc8-ca3e6a337071 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:55.930112 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ad2185bd-d015-4ecd-acc8-ca3e6a337071 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1565 microversion: 2.1 time: 0.172601 Nov 02 07:31:55.930729 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 186/363] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:55 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:55.954569 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7eaf998b-e5fa-4c84-b9d3-1409ff9a111c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:55.955049 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-7eaf998b-e5fa-4c84-b9d3-1409ff9a111c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:55.957236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=4 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:55.963672 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7eaf998b-e5fa-4c84-b9d3-1409ff9a111c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:55.964550 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7eaf998b-e5fa-4c84-b9d3-1409ff9a111c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:55.965236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7eaf998b-e5fa-4c84-b9d3-1409ff9a111c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:55.965979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7eaf998b-e5fa-4c84-b9d3-1409ff9a111c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:55.966870 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7eaf998b-e5fa-4c84-b9d3-1409ff9a111c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:55.967729 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7eaf998b-e5fa-4c84-b9d3-1409ff9a111c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:56.052839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-7eaf998b-e5fa-4c84-b9d3-1409ff9a111c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102302 Nov 02 07:31:56.053673 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 178/364] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 07:31:55 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:31:56.311410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-64ce571e-033b-4ad9-ad06-df51be0184f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:56.312208 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-64ce571e-033b-4ad9-ad06-df51be0184f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:56.319398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-64ce571e-033b-4ad9-ad06-df51be0184f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:56.320046 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-64ce571e-033b-4ad9-ad06-df51be0184f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:56.320604 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-64ce571e-033b-4ad9-ad06-df51be0184f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:56.321414 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-64ce571e-033b-4ad9-ad06-df51be0184f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:56.322258 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-64ce571e-033b-4ad9-ad06-df51be0184f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:56.322931 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-64ce571e-033b-4ad9-ad06-df51be0184f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:56.465477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-35871da8-bdc5-410c-a7b4-2b8800fd63de tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:56.468082 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-35871da8-bdc5-410c-a7b4-2b8800fd63de tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:56.491237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-35871da8-bdc5-410c-a7b4-2b8800fd63de tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:56.491750 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-35871da8-bdc5-410c-a7b4-2b8800fd63de tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:56.492190 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-35871da8-bdc5-410c-a7b4-2b8800fd63de tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:56.493109 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-35871da8-bdc5-410c-a7b4-2b8800fd63de tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:56.493554 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-35871da8-bdc5-410c-a7b4-2b8800fd63de tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:56.493973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-35871da8-bdc5-410c-a7b4-2b8800fd63de tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:56.500383 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:31:56.544284 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-64ce571e-033b-4ad9-ad06-df51be0184f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:56.555391 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-64ce571e-033b-4ad9-ad06-df51be0184f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.248336 Nov 02 07:31:56.569585 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 187/365] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:56 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:56.710379 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-35871da8-bdc5-410c-a7b4-2b8800fd63de tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:56.720230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-35871da8-bdc5-410c-a7b4-2b8800fd63de tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:56.722019 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-35871da8-bdc5-410c-a7b4-2b8800fd63de tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:56.723404 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-35871da8-bdc5-410c-a7b4-2b8800fd63de tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.263378 Nov 02 07:31:56.724426 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 179/366] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:56 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:57.380770 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-bc63f015-294f-425d-ac16-e505395832b6 req-2d37c935-156d-4397-bba0-28e4ed1772b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f8c1657-4f0c-4856-aa2f-7536a549ad16", "tag": "47c195f9-fe3d-4872-a0a9-ef4120548d09"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:31:57.391732 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-bc63f015-294f-425d-ac16-e505395832b6 req-2d37c935-156d-4397-bba0-28e4ed1772b1 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:57.392210 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-bc63f015-294f-425d-ac16-e505395832b6 req-2d37c935-156d-4397-bba0-28e4ed1772b1 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:57.392633 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-bc63f015-294f-425d-ac16-e505395832b6 req-2d37c935-156d-4397-bba0-28e4ed1772b1 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:57.411738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-bc63f015-294f-425d-ac16-e505395832b6 req-2d37c935-156d-4397-bba0-28e4ed1772b1 service nova] Creating event network-changed:47c195f9-fe3d-4872-a0a9-ef4120548d09 for instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 on hv-cinder-80473 Nov 02 07:31:57.417357 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-bc63f015-294f-425d-ac16-e505395832b6 req-2d37c935-156d-4397-bba0-28e4ed1772b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040196 Nov 02 07:31:57.418031 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 188/367] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:31:57.584489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ee8c98f6-848d-4d34-b59f-3563b45aec8c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:57.585732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ee8c98f6-848d-4d34-b59f-3563b45aec8c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:57.592641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ee8c98f6-848d-4d34-b59f-3563b45aec8c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:57.593124 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ee8c98f6-848d-4d34-b59f-3563b45aec8c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:57.593727 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ee8c98f6-848d-4d34-b59f-3563b45aec8c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:57.594579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ee8c98f6-848d-4d34-b59f-3563b45aec8c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:57.595114 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ee8c98f6-848d-4d34-b59f-3563b45aec8c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:57.595538 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ee8c98f6-848d-4d34-b59f-3563b45aec8c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:57.755512 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-dd66ba7c-a30d-40e7-883d-e75f32d6e83a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:57.756168 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-dd66ba7c-a30d-40e7-883d-e75f32d6e83a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:57.763141 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ee8c98f6-848d-4d34-b59f-3563b45aec8c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:57.769254 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dd66ba7c-a30d-40e7-883d-e75f32d6e83a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:57.769761 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dd66ba7c-a30d-40e7-883d-e75f32d6e83a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:57.770173 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dd66ba7c-a30d-40e7-883d-e75f32d6e83a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:57.770900 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dd66ba7c-a30d-40e7-883d-e75f32d6e83a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:57.771346 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dd66ba7c-a30d-40e7-883d-e75f32d6e83a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:57.771835 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dd66ba7c-a30d-40e7-883d-e75f32d6e83a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:57.773179 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ee8c98f6-848d-4d34-b59f-3563b45aec8c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.193877 Nov 02 07:31:57.774373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 180/368] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:57 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:31:57.940926 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-dd66ba7c-a30d-40e7-883d-e75f32d6e83a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:57.950240 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-dd66ba7c-a30d-40e7-883d-e75f32d6e83a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:57.952047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-dd66ba7c-a30d-40e7-883d-e75f32d6e83a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:57.954652 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-dd66ba7c-a30d-40e7-883d-e75f32d6e83a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.203367 Nov 02 07:31:57.956260 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 189/369] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:57 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:31:58.801985 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-667a8669-4d04-45db-976e-c373a3bd59b4 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:58.802668 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-667a8669-4d04-45db-976e-c373a3bd59b4 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:58.809533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-667a8669-4d04-45db-976e-c373a3bd59b4 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:58.810732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-667a8669-4d04-45db-976e-c373a3bd59b4 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:58.810945 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-667a8669-4d04-45db-976e-c373a3bd59b4 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:58.811661 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-667a8669-4d04-45db-976e-c373a3bd59b4 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:58.812121 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-667a8669-4d04-45db-976e-c373a3bd59b4 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:58.812539 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-667a8669-4d04-45db-976e-c373a3bd59b4 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:58.960727 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-667a8669-4d04-45db-976e-c373a3bd59b4 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:58.969263 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-667a8669-4d04-45db-976e-c373a3bd59b4 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.171220 Nov 02 07:31:58.969835 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 181/370] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:58 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:31:58.983305 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-452fdb47-7eb1-4e65-bc3e-d45edc7b481c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:58.983951 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-452fdb47-7eb1-4e65-bc3e-d45edc7b481c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:31:58.989820 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-452fdb47-7eb1-4e65-bc3e-d45edc7b481c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:58.990296 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-452fdb47-7eb1-4e65-bc3e-d45edc7b481c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:58.990750 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-452fdb47-7eb1-4e65-bc3e-d45edc7b481c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:58.991438 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-452fdb47-7eb1-4e65-bc3e-d45edc7b481c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:31:58.991880 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-452fdb47-7eb1-4e65-bc3e-d45edc7b481c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:31:58.992296 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-452fdb47-7eb1-4e65-bc3e-d45edc7b481c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:31:59.131605 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-452fdb47-7eb1-4e65-bc3e-d45edc7b481c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:59.141175 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-452fdb47-7eb1-4e65-bc3e-d45edc7b481c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:59.142905 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-452fdb47-7eb1-4e65-bc3e-d45edc7b481c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:31:59.144070 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-452fdb47-7eb1-4e65-bc3e-d45edc7b481c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.164832 Nov 02 07:31:59.144615 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 190/371] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:31:58 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:31:59.993047 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-b6abba31-7cf8-4f43-b951-50e22aa644f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:31:59.993659 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-b6abba31-7cf8-4f43-b951-50e22aa644f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:00.001303 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b6abba31-7cf8-4f43-b951-50e22aa644f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:00.001785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b6abba31-7cf8-4f43-b951-50e22aa644f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:00.002214 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b6abba31-7cf8-4f43-b951-50e22aa644f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:00.002935 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b6abba31-7cf8-4f43-b951-50e22aa644f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:00.003384 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b6abba31-7cf8-4f43-b951-50e22aa644f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:00.003806 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b6abba31-7cf8-4f43-b951-50e22aa644f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:00.144173 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-b6abba31-7cf8-4f43-b951-50e22aa644f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:00.157535 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-b6abba31-7cf8-4f43-b951-50e22aa644f2 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.167906 Nov 02 07:32:00.158584 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 182/372] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:31:59 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:00.172841 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-697ceeb2-d3b5-4cee-8c7b-e3f200a21bd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:00.173563 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-697ceeb2-d3b5-4cee-8c7b-e3f200a21bd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:00.179948 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-697ceeb2-d3b5-4cee-8c7b-e3f200a21bd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:00.180708 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-697ceeb2-d3b5-4cee-8c7b-e3f200a21bd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:00.181223 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-697ceeb2-d3b5-4cee-8c7b-e3f200a21bd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:00.182014 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-697ceeb2-d3b5-4cee-8c7b-e3f200a21bd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:00.182573 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-697ceeb2-d3b5-4cee-8c7b-e3f200a21bd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:00.183109 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-697ceeb2-d3b5-4cee-8c7b-e3f200a21bd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:00.319360 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-697ceeb2-d3b5-4cee-8c7b-e3f200a21bd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:00.329456 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-697ceeb2-d3b5-4cee-8c7b-e3f200a21bd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:00.330925 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-697ceeb2-d3b5-4cee-8c7b-e3f200a21bd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:00.332089 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-697ceeb2-d3b5-4cee-8c7b-e3f200a21bd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.163730 Nov 02 07:32:00.332642 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 191/373] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:00 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:32:01.182187 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7c90fa2b-35e0-4cb2-8f29-717158984853 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:01.182812 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-7c90fa2b-35e0-4cb2-8f29-717158984853 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:01.190110 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7c90fa2b-35e0-4cb2-8f29-717158984853 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:01.190621 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7c90fa2b-35e0-4cb2-8f29-717158984853 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:01.191054 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7c90fa2b-35e0-4cb2-8f29-717158984853 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:01.191748 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7c90fa2b-35e0-4cb2-8f29-717158984853 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:01.192194 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7c90fa2b-35e0-4cb2-8f29-717158984853 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:01.192613 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7c90fa2b-35e0-4cb2-8f29-717158984853 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:01.346084 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-7c90fa2b-35e0-4cb2-8f29-717158984853 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:01.354152 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-7c90fa2b-35e0-4cb2-8f29-717158984853 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.176608 Nov 02 07:32:01.355150 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 183/374] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:01 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:01.357119 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:01.359410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=8 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:01.365867 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ab398b28-2ec3-44d3-b793-e6444e3aa0e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:01.366541 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-ab398b28-2ec3-44d3-b793-e6444e3aa0e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:01.374656 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ab398b28-2ec3-44d3-b793-e6444e3aa0e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:01.375140 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ab398b28-2ec3-44d3-b793-e6444e3aa0e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:01.375572 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ab398b28-2ec3-44d3-b793-e6444e3aa0e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:01.376266 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ab398b28-2ec3-44d3-b793-e6444e3aa0e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:01.376715 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ab398b28-2ec3-44d3-b793-e6444e3aa0e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:01.377136 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ab398b28-2ec3-44d3-b793-e6444e3aa0e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:01.532493 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ab398b28-2ec3-44d3-b793-e6444e3aa0e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:01.541438 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ab398b28-2ec3-44d3-b793-e6444e3aa0e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:01.543005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ab398b28-2ec3-44d3-b793-e6444e3aa0e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:01.544293 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ab398b28-2ec3-44d3-b793-e6444e3aa0e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.188004 Nov 02 07:32:01.544841 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 192/375] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:01 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:32:02.379489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-dfd70135-5ecb-4311-883c-767de04e44c6 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:02.380697 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-dfd70135-5ecb-4311-883c-767de04e44c6 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:02.387860 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dfd70135-5ecb-4311-883c-767de04e44c6 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:02.388668 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dfd70135-5ecb-4311-883c-767de04e44c6 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:02.389775 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dfd70135-5ecb-4311-883c-767de04e44c6 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:02.390813 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dfd70135-5ecb-4311-883c-767de04e44c6 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:02.391303 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dfd70135-5ecb-4311-883c-767de04e44c6 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:02.391793 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dfd70135-5ecb-4311-883c-767de04e44c6 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:02.555403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-dfd70135-5ecb-4311-883c-767de04e44c6 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:02.564463 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-dfd70135-5ecb-4311-883c-767de04e44c6 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.190698 Nov 02 07:32:02.566490 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 184/376] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:02 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:02.571606 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a6f067e2-254c-4171-8fdc-85753e6114b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:02.572366 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a6f067e2-254c-4171-8fdc-85753e6114b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:02.578579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6f067e2-254c-4171-8fdc-85753e6114b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:02.579062 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6f067e2-254c-4171-8fdc-85753e6114b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:02.579491 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6f067e2-254c-4171-8fdc-85753e6114b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:02.580180 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6f067e2-254c-4171-8fdc-85753e6114b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:02.580638 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6f067e2-254c-4171-8fdc-85753e6114b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:02.581044 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6f067e2-254c-4171-8fdc-85753e6114b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:02.724259 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a6f067e2-254c-4171-8fdc-85753e6114b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:02.733202 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a6f067e2-254c-4171-8fdc-85753e6114b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:02.734694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a6f067e2-254c-4171-8fdc-85753e6114b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:02.735884 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a6f067e2-254c-4171-8fdc-85753e6114b1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.168161 Nov 02 07:32:02.736669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 193/377] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:02 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:32:03.587704 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-15888b14-6ab1-4cd1-84d2-c26c234fe465 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:03.588316 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-15888b14-6ab1-4cd1-84d2-c26c234fe465 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:03.596002 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-15888b14-6ab1-4cd1-84d2-c26c234fe465 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:03.596475 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-15888b14-6ab1-4cd1-84d2-c26c234fe465 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:03.596965 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-15888b14-6ab1-4cd1-84d2-c26c234fe465 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:03.597599 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-15888b14-6ab1-4cd1-84d2-c26c234fe465 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:03.598046 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-15888b14-6ab1-4cd1-84d2-c26c234fe465 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:03.598487 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-15888b14-6ab1-4cd1-84d2-c26c234fe465 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:03.738519 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-15888b14-6ab1-4cd1-84d2-c26c234fe465 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:03.746981 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-15888b14-6ab1-4cd1-84d2-c26c234fe465 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.162966 Nov 02 07:32:03.747482 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 185/378] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:03 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:03.763178 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d02003fe-df0f-499b-95a5-0ad0634495b6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:03.764544 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-d02003fe-df0f-499b-95a5-0ad0634495b6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:03.770871 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d02003fe-df0f-499b-95a5-0ad0634495b6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:03.771363 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d02003fe-df0f-499b-95a5-0ad0634495b6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:03.771879 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d02003fe-df0f-499b-95a5-0ad0634495b6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:03.772716 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d02003fe-df0f-499b-95a5-0ad0634495b6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:03.773316 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d02003fe-df0f-499b-95a5-0ad0634495b6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:03.773687 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d02003fe-df0f-499b-95a5-0ad0634495b6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:03.912744 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d02003fe-df0f-499b-95a5-0ad0634495b6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:03.921526 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d02003fe-df0f-499b-95a5-0ad0634495b6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:03.922974 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d02003fe-df0f-499b-95a5-0ad0634495b6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:03.924136 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d02003fe-df0f-499b-95a5-0ad0634495b6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.165408 Nov 02 07:32:03.924681 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 194/379] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:03 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:32:04.671964 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-723644379", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-399650938", "security_groups": [{"name": "tempest-secgroup-smoke-1590256925"}], "networks": [{"uuid": "a4b569f4-0220-4fbb-945d-473979044420"}], "block_device_mapping_v2": [{"uuid": "09fa60fb-b23c-4d95-975d-631bdd7c5821", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:32:04.770926 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-11ea95c4-76a1-4d0a-a6a5-458973817399 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:04.771522 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-11ea95c4-76a1-4d0a-a6a5-458973817399 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:04.782869 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-11ea95c4-76a1-4d0a-a6a5-458973817399 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:04.784765 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-11ea95c4-76a1-4d0a-a6a5-458973817399 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:04.784765 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-11ea95c4-76a1-4d0a-a6a5-458973817399 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:04.784765 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-11ea95c4-76a1-4d0a-a6a5-458973817399 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:04.785090 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-11ea95c4-76a1-4d0a-a6a5-458973817399 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:04.785427 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-11ea95c4-76a1-4d0a-a6a5-458973817399 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:04.800606 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.network.neutron [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] validate_networks() for [('a4b569f4-0220-4fbb-945d-473979044420', None, None, None, None, None)] {{(pid=118992) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:32:05.040542 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-11ea95c4-76a1-4d0a-a6a5-458973817399 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:05.050092 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-11ea95c4-76a1-4d0a-a6a5-458973817399 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.282802 Nov 02 07:32:05.050693 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 195/380] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:04 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:05.062386 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-814d72ac-a0ff-410e-b83d-e5fb18f034cf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:05.062386 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-814d72ac-a0ff-410e-b83d-e5fb18f034cf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:05.067380 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-814d72ac-a0ff-410e-b83d-e5fb18f034cf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:05.067380 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-814d72ac-a0ff-410e-b83d-e5fb18f034cf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:05.067380 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-814d72ac-a0ff-410e-b83d-e5fb18f034cf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:05.067380 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-814d72ac-a0ff-410e-b83d-e5fb18f034cf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:05.067745 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-814d72ac-a0ff-410e-b83d-e5fb18f034cf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:05.067745 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-814d72ac-a0ff-410e-b83d-e5fb18f034cf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:05.322377 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-814d72ac-a0ff-410e-b83d-e5fb18f034cf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:05.331329 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-814d72ac-a0ff-410e-b83d-e5fb18f034cf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:05.332761 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-814d72ac-a0ff-410e-b83d-e5fb18f034cf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:05.333938 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-814d72ac-a0ff-410e-b83d-e5fb18f034cf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.282323 Nov 02 07:32:05.340691 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 196/381] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:05 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:32:05.363016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-dc72ee8f-5bc2-4455-8496-dcdd83edc327 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:05.363527 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-dc72ee8f-5bc2-4455-8496-dcdd83edc327 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:05.369799 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dc72ee8f-5bc2-4455-8496-dcdd83edc327 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:05.370291 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dc72ee8f-5bc2-4455-8496-dcdd83edc327 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:05.371345 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dc72ee8f-5bc2-4455-8496-dcdd83edc327 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:05.372084 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dc72ee8f-5bc2-4455-8496-dcdd83edc327 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:05.372538 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dc72ee8f-5bc2-4455-8496-dcdd83edc327 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:05.372966 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dc72ee8f-5bc2-4455-8496-dcdd83edc327 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:05.411279 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-dc72ee8f-5bc2-4455-8496-dcdd83edc327 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab/ips" status: 200 len: 148 microversion: 2.1 time: 0.069336 Nov 02 07:32:05.412227 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 197/382] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 07:32:05 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab/ips => generated 148 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:32:05.429709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Flavor limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:32:05.430134 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Image limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:32:05.430778 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Flavor pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:32:05.431238 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Image pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:32:05.431592 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:32:05.442532 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:05.443022 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:05.443459 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:05.444346 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:05.444801 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:05.445222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:05.462877 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Getting quotas for project 82915a36bbdb4b5998fd98833e234ad2. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:32:05.467709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Getting quotas for user 040b847b0db549a2a865deb7be6a8da7 and project 82915a36bbdb4b5998fd98833e234ad2. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:32:05.528332 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Going to run 1 instances... {{(pid=118992) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:32:05.530991 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='09fa60fb-b23c-4d95-975d-631bdd7c5821',volume_size=None,volume_type=None)] {{(pid=118992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:32:05.672338 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c6330e64-8a3c-40f7-9391-3ca867320a96 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.005030 Nov 02 07:32:05.673347 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 186/383] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:32:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 07:32:05.686771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-83a4ed61-e73c-4169-b060-7b342cad136b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:05.687382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-83a4ed61-e73c-4169-b060-7b342cad136b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:05.767179 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-83a4ed61-e73c-4169-b060-7b342cad136b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:05.774352 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-83a4ed61-e73c-4169-b060-7b342cad136b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1087 microversion: 2.1 time: 0.092339 Nov 02 07:32:05.775659 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 198/384] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:05 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1087 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:06.075724 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-55e996c3-223f-47fe-8d1b-71218745466a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:06.076895 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-55e996c3-223f-47fe-8d1b-71218745466a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:06.083996 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-55e996c3-223f-47fe-8d1b-71218745466a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:06.084489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-55e996c3-223f-47fe-8d1b-71218745466a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:06.084914 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-55e996c3-223f-47fe-8d1b-71218745466a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:06.085828 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-55e996c3-223f-47fe-8d1b-71218745466a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:06.086310 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-55e996c3-223f-47fe-8d1b-71218745466a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:06.086782 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-55e996c3-223f-47fe-8d1b-71218745466a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:06.220801 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-55e996c3-223f-47fe-8d1b-71218745466a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:06.228727 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-55e996c3-223f-47fe-8d1b-71218745466a tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.157510 Nov 02 07:32:06.229290 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 187/385] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:06 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:06.371318 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b67437ea-d065-42b3-9239-9f91c6777851 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:06.372183 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b67437ea-d065-42b3-9239-9f91c6777851 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:06.380518 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b67437ea-d065-42b3-9239-9f91c6777851 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:06.380999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b67437ea-d065-42b3-9239-9f91c6777851 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:06.381599 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b67437ea-d065-42b3-9239-9f91c6777851 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:06.382536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b67437ea-d065-42b3-9239-9f91c6777851 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:06.383030 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b67437ea-d065-42b3-9239-9f91c6777851 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:06.384142 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b67437ea-d065-42b3-9239-9f91c6777851 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:06.577042 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b67437ea-d065-42b3-9239-9f91c6777851 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:06.585766 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b67437ea-d065-42b3-9239-9f91c6777851 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:06.587314 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b67437ea-d065-42b3-9239-9f91c6777851 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:06.588480 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b67437ea-d065-42b3-9239-9f91c6777851 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.223204 Nov 02 07:32:06.589033 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 199/386] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:06 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:32:06.796996 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1bd6d67e-56e4-4a79-b6b0-b93a07d21f69 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:06.797693 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1bd6d67e-56e4-4a79-b6b0-b93a07d21f69 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:06.803609 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1bd6d67e-56e4-4a79-b6b0-b93a07d21f69 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:06.804092 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1bd6d67e-56e4-4a79-b6b0-b93a07d21f69 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:06.804672 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1bd6d67e-56e4-4a79-b6b0-b93a07d21f69 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:06.805200 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1bd6d67e-56e4-4a79-b6b0-b93a07d21f69 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:06.805647 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1bd6d67e-56e4-4a79-b6b0-b93a07d21f69 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:06.806065 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1bd6d67e-56e4-4a79-b6b0-b93a07d21f69 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:06.841814 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-9a2537fe-0432-431e-9202-686d0908bb21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bad46e0b-e50f-43d1-890a-15bb3d66550f"}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:32:06.844257 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-9a2537fe-0432-431e-9202-686d0908bb21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:06.850500 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a2537fe-0432-431e-9202-686d0908bb21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:06.850979 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a2537fe-0432-431e-9202-686d0908bb21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:06.851409 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a2537fe-0432-431e-9202-686d0908bb21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:06.852159 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a2537fe-0432-431e-9202-686d0908bb21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:06.852603 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a2537fe-0432-431e-9202-686d0908bb21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:06.853017 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a2537fe-0432-431e-9202-686d0908bb21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:06.868002 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1bd6d67e-56e4-4a79-b6b0-b93a07d21f69 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:06.876138 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-1bd6d67e-56e4-4a79-b6b0-b93a07d21f69 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1129 microversion: 2.1 time: 0.083136 Nov 02 07:32:06.876701 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 188/387] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:06 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1129 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:07.242925 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:07.252901 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3d5bf4d0-af16-4fc1-9ae3-faaccf10526d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:07.253892 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3d5bf4d0-af16-4fc1-9ae3-faaccf10526d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:07.268641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d5bf4d0-af16-4fc1-9ae3-faaccf10526d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:07.269286 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d5bf4d0-af16-4fc1-9ae3-faaccf10526d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:07.271179 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-9a2537fe-0432-431e-9202-686d0908bb21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "POST /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.433060 Nov 02 07:32:07.274780 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d5bf4d0-af16-4fc1-9ae3-faaccf10526d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:07.275721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d5bf4d0-af16-4fc1-9ae3-faaccf10526d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:07.276335 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d5bf4d0-af16-4fc1-9ae3-faaccf10526d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:07.276906 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d5bf4d0-af16-4fc1-9ae3-faaccf10526d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:07.278499 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 200/388] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 07:32:06 2022] POST /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:32:07.541093 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3d5bf4d0-af16-4fc1-9ae3-faaccf10526d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:07.549784 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3d5bf4d0-af16-4fc1-9ae3-faaccf10526d tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.302375 Nov 02 07:32:07.550498 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 189/389] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:07 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:07.615062 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-4925f336-81e6-4a2e-8b5e-d3f41e8cf864 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:07.615783 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-4925f336-81e6-4a2e-8b5e-d3f41e8cf864 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:07.624177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4925f336-81e6-4a2e-8b5e-d3f41e8cf864 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:07.624686 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4925f336-81e6-4a2e-8b5e-d3f41e8cf864 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:07.625132 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4925f336-81e6-4a2e-8b5e-d3f41e8cf864 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:07.625788 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4925f336-81e6-4a2e-8b5e-d3f41e8cf864 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:07.626227 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4925f336-81e6-4a2e-8b5e-d3f41e8cf864 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:07.626672 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4925f336-81e6-4a2e-8b5e-d3f41e8cf864 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:07.758426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-4925f336-81e6-4a2e-8b5e-d3f41e8cf864 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:07.767591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-4925f336-81e6-4a2e-8b5e-d3f41e8cf864 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:07.769005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-4925f336-81e6-4a2e-8b5e-d3f41e8cf864 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:07.770152 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-4925f336-81e6-4a2e-8b5e-d3f41e8cf864 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.159339 Nov 02 07:32:07.770725 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 201/390] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:07 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:32:07.899990 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2da91248-fea5-436c-818c-c8faf448a528 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:07.900536 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-2da91248-fea5-436c-818c-c8faf448a528 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:07.906514 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2da91248-fea5-436c-818c-c8faf448a528 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:07.906996 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2da91248-fea5-436c-818c-c8faf448a528 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:07.907433 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2da91248-fea5-436c-818c-c8faf448a528 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:07.908130 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2da91248-fea5-436c-818c-c8faf448a528 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:07.908566 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2da91248-fea5-436c-818c-c8faf448a528 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:07.908987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2da91248-fea5-436c-818c-c8faf448a528 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:07.972815 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2da91248-fea5-436c-818c-c8faf448a528 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:07.980510 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-2da91248-fea5-436c-818c-c8faf448a528 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1185 microversion: 2.1 time: 0.084508 Nov 02 07:32:07.981067 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 190/391] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:07 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:08.573764 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a54093de-a605-4b8c-89e8-05d7c892df9c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:08.574392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a54093de-a605-4b8c-89e8-05d7c892df9c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:08.581622 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a54093de-a605-4b8c-89e8-05d7c892df9c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:08.582098 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a54093de-a605-4b8c-89e8-05d7c892df9c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:08.582568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a54093de-a605-4b8c-89e8-05d7c892df9c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:08.583260 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a54093de-a605-4b8c-89e8-05d7c892df9c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:08.583709 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a54093de-a605-4b8c-89e8-05d7c892df9c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:08.584133 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a54093de-a605-4b8c-89e8-05d7c892df9c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:08.716687 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a54093de-a605-4b8c-89e8-05d7c892df9c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:08.724329 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a54093de-a605-4b8c-89e8-05d7c892df9c tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.154394 Nov 02 07:32:08.724877 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 202/392] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:08 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:08.795217 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-39305b44-b6ee-4a8b-9029-6bb2669a5fb1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:08.795821 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-39305b44-b6ee-4a8b-9029-6bb2669a5fb1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:08.802771 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-39305b44-b6ee-4a8b-9029-6bb2669a5fb1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:08.803246 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-39305b44-b6ee-4a8b-9029-6bb2669a5fb1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:08.803672 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-39305b44-b6ee-4a8b-9029-6bb2669a5fb1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:08.804346 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-39305b44-b6ee-4a8b-9029-6bb2669a5fb1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:08.804795 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-39305b44-b6ee-4a8b-9029-6bb2669a5fb1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:08.805210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-39305b44-b6ee-4a8b-9029-6bb2669a5fb1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:08.934836 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-39305b44-b6ee-4a8b-9029-6bb2669a5fb1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:08.944002 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-39305b44-b6ee-4a8b-9029-6bb2669a5fb1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:08.945432 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-39305b44-b6ee-4a8b-9029-6bb2669a5fb1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:08.946608 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-39305b44-b6ee-4a8b-9029-6bb2669a5fb1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.155243 Nov 02 07:32:08.947158 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 191/393] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:08 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:32:09.003854 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-3562243e-69ec-404e-84bf-486f07e95005 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:09.004580 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-3562243e-69ec-404e-84bf-486f07e95005 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:09.007689 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:09.011782 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3562243e-69ec-404e-84bf-486f07e95005 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:09.012254 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3562243e-69ec-404e-84bf-486f07e95005 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:09.012681 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3562243e-69ec-404e-84bf-486f07e95005 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:09.013388 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3562243e-69ec-404e-84bf-486f07e95005 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:09.013829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3562243e-69ec-404e-84bf-486f07e95005 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:09.014244 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3562243e-69ec-404e-84bf-486f07e95005 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:09.079980 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-3562243e-69ec-404e-84bf-486f07e95005 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:09.088987 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-3562243e-69ec-404e-84bf-486f07e95005 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1185 microversion: 2.1 time: 0.089557 Nov 02 07:32:09.089556 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 203/394] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:08 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:09.747929 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1fd7298d-60d4-4939-b9c1-dcc2750dabf0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:09.748421 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1fd7298d-60d4-4939-b9c1-dcc2750dabf0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:09.755393 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1fd7298d-60d4-4939-b9c1-dcc2750dabf0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:09.755880 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1fd7298d-60d4-4939-b9c1-dcc2750dabf0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:09.756329 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1fd7298d-60d4-4939-b9c1-dcc2750dabf0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:09.757014 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1fd7298d-60d4-4939-b9c1-dcc2750dabf0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:09.757510 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1fd7298d-60d4-4939-b9c1-dcc2750dabf0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:09.757930 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1fd7298d-60d4-4939-b9c1-dcc2750dabf0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:09.968140 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1fd7298d-60d4-4939-b9c1-dcc2750dabf0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:09.972981 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-05b71b6c-30cb-4c47-a20e-b35e7aa043f1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:09.974314 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-05b71b6c-30cb-4c47-a20e-b35e7aa043f1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:09.978658 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-1fd7298d-60d4-4939-b9c1-dcc2750dabf0 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.234678 Nov 02 07:32:09.981980 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-05b71b6c-30cb-4c47-a20e-b35e7aa043f1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:09.982635 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-05b71b6c-30cb-4c47-a20e-b35e7aa043f1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:09.983065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-05b71b6c-30cb-4c47-a20e-b35e7aa043f1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:09.983814 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-05b71b6c-30cb-4c47-a20e-b35e7aa043f1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:09.984413 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-05b71b6c-30cb-4c47-a20e-b35e7aa043f1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:09.984973 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-05b71b6c-30cb-4c47-a20e-b35e7aa043f1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:09.990915 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 192/395] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:09 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:10.112673 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-02caa0e7-405f-40ee-aea1-2d13f6d2c633 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:10.113282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-02caa0e7-405f-40ee-aea1-2d13f6d2c633 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:10.119428 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-02caa0e7-405f-40ee-aea1-2d13f6d2c633 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:10.120300 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-02caa0e7-405f-40ee-aea1-2d13f6d2c633 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:10.120736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-02caa0e7-405f-40ee-aea1-2d13f6d2c633 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:10.121705 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-02caa0e7-405f-40ee-aea1-2d13f6d2c633 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:10.122156 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-02caa0e7-405f-40ee-aea1-2d13f6d2c633 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:10.122647 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-02caa0e7-405f-40ee-aea1-2d13f6d2c633 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:10.254161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-05b71b6c-30cb-4c47-a20e-b35e7aa043f1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:10.262725 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-05b71b6c-30cb-4c47-a20e-b35e7aa043f1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:10.264143 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-05b71b6c-30cb-4c47-a20e-b35e7aa043f1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:10.265301 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-05b71b6c-30cb-4c47-a20e-b35e7aa043f1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.296793 Nov 02 07:32:10.265838 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 204/396] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:09 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:32:10.380463 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-02caa0e7-405f-40ee-aea1-2d13f6d2c633 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:10.388336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-02caa0e7-405f-40ee-aea1-2d13f6d2c633 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1271 microversion: 2.1 time: 0.279499 Nov 02 07:32:10.388997 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 193/397] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:10 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1271 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:11.001251 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-524d9bf2-33a6-4b30-b6e9-0666aa9044bd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:11.002045 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-524d9bf2-33a6-4b30-b6e9-0666aa9044bd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:11.008787 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-524d9bf2-33a6-4b30-b6e9-0666aa9044bd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:11.009369 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-524d9bf2-33a6-4b30-b6e9-0666aa9044bd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:11.009794 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-524d9bf2-33a6-4b30-b6e9-0666aa9044bd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:11.010503 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-524d9bf2-33a6-4b30-b6e9-0666aa9044bd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:11.010948 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-524d9bf2-33a6-4b30-b6e9-0666aa9044bd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:11.011361 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-524d9bf2-33a6-4b30-b6e9-0666aa9044bd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:11.161603 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-c9abffdb-8f19-4413-bcd6-91b95693c762 req-4ccbcf9a-face-4b98-9c12-ec2c85c8e8fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ad3728-5dee-49b1-a62d-3bdfca6b47ce", "tag": "697a5305-479b-4888-ac9b-d59e4662ea13"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:32:11.173097 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c9abffdb-8f19-4413-bcd6-91b95693c762 req-4ccbcf9a-face-4b98-9c12-ec2c85c8e8fe service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:11.173577 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c9abffdb-8f19-4413-bcd6-91b95693c762 req-4ccbcf9a-face-4b98-9c12-ec2c85c8e8fe service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:11.174000 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c9abffdb-8f19-4413-bcd6-91b95693c762 req-4ccbcf9a-face-4b98-9c12-ec2c85c8e8fe service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:11.185573 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-c9abffdb-8f19-4413-bcd6-91b95693c762 req-4ccbcf9a-face-4b98-9c12-ec2c85c8e8fe service nova] Creating event network-changed:697a5305-479b-4888-ac9b-d59e4662ea13 for instance 22ad3728-5dee-49b1-a62d-3bdfca6b47ce on hv-cinder-80473 Nov 02 07:32:11.191729 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-c9abffdb-8f19-4413-bcd6-91b95693c762 req-4ccbcf9a-face-4b98-9c12-ec2c85c8e8fe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033755 Nov 02 07:32:11.192457 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 194/398] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:32:11.215099 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-524d9bf2-33a6-4b30-b6e9-0666aa9044bd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:11.223302 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-524d9bf2-33a6-4b30-b6e9-0666aa9044bd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.225850 Nov 02 07:32:11.223877 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 205/399] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:10 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:11.293870 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-b2f16117-86f2-4027-92c3-3bd51459706d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:11.294590 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-b2f16117-86f2-4027-92c3-3bd51459706d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:11.301273 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b2f16117-86f2-4027-92c3-3bd51459706d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:11.301754 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b2f16117-86f2-4027-92c3-3bd51459706d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:11.302187 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b2f16117-86f2-4027-92c3-3bd51459706d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:11.302930 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b2f16117-86f2-4027-92c3-3bd51459706d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:11.303382 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b2f16117-86f2-4027-92c3-3bd51459706d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:11.303803 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b2f16117-86f2-4027-92c3-3bd51459706d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:11.412776 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-24588dc7-9fca-4a41-92d5-fadb85694279 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:11.413294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-24588dc7-9fca-4a41-92d5-fadb85694279 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:11.419801 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24588dc7-9fca-4a41-92d5-fadb85694279 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:11.420468 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24588dc7-9fca-4a41-92d5-fadb85694279 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:11.420896 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24588dc7-9fca-4a41-92d5-fadb85694279 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:11.422425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24588dc7-9fca-4a41-92d5-fadb85694279 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:11.423035 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24588dc7-9fca-4a41-92d5-fadb85694279 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:11.423609 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24588dc7-9fca-4a41-92d5-fadb85694279 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:11.558689 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-b2f16117-86f2-4027-92c3-3bd51459706d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:11.568813 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-b2f16117-86f2-4027-92c3-3bd51459706d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:11.570485 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-b2f16117-86f2-4027-92c3-3bd51459706d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:11.571836 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-b2f16117-86f2-4027-92c3-3bd51459706d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.282278 Nov 02 07:32:11.587501 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 195/400] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:11 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:32:11.668329 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-24588dc7-9fca-4a41-92d5-fadb85694279 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:11.676695 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-24588dc7-9fca-4a41-92d5-fadb85694279 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1271 microversion: 2.1 time: 0.267898 Nov 02 07:32:11.677273 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 206/401] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:11 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1271 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:12.244939 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e400dffb-5906-4115-bc22-a471bd99f00e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:12.245455 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e400dffb-5906-4115-bc22-a471bd99f00e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:12.252667 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e400dffb-5906-4115-bc22-a471bd99f00e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:12.253143 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e400dffb-5906-4115-bc22-a471bd99f00e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:12.253561 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e400dffb-5906-4115-bc22-a471bd99f00e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:12.254234 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e400dffb-5906-4115-bc22-a471bd99f00e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:12.254705 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e400dffb-5906-4115-bc22-a471bd99f00e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:12.255143 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e400dffb-5906-4115-bc22-a471bd99f00e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:12.453727 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-e400dffb-5906-4115-bc22-a471bd99f00e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:12.461465 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e400dffb-5906-4115-bc22-a471bd99f00e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.220381 Nov 02 07:32:12.462029 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 196/402] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:12 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:12.600983 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8a7ecd6a-54e9-4817-ab66-2e05c19fd4a7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:12.601576 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8a7ecd6a-54e9-4817-ab66-2e05c19fd4a7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:12.608011 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8a7ecd6a-54e9-4817-ab66-2e05c19fd4a7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:12.608480 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8a7ecd6a-54e9-4817-ab66-2e05c19fd4a7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:12.609475 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8a7ecd6a-54e9-4817-ab66-2e05c19fd4a7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:12.610315 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8a7ecd6a-54e9-4817-ab66-2e05c19fd4a7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:12.610795 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8a7ecd6a-54e9-4817-ab66-2e05c19fd4a7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:12.611211 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8a7ecd6a-54e9-4817-ab66-2e05c19fd4a7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:12.699287 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c8e32399-aea6-4c8d-ab65-61fa493e4dab tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:12.699918 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c8e32399-aea6-4c8d-ab65-61fa493e4dab tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:12.706046 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c8e32399-aea6-4c8d-ab65-61fa493e4dab tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:12.706570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c8e32399-aea6-4c8d-ab65-61fa493e4dab tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:12.707007 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c8e32399-aea6-4c8d-ab65-61fa493e4dab tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:12.707687 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c8e32399-aea6-4c8d-ab65-61fa493e4dab tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:12.708134 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c8e32399-aea6-4c8d-ab65-61fa493e4dab tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:12.708550 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c8e32399-aea6-4c8d-ab65-61fa493e4dab tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:12.712705 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=100 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:12.756943 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8a7ecd6a-54e9-4817-ab66-2e05c19fd4a7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:12.766172 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8a7ecd6a-54e9-4817-ab66-2e05c19fd4a7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:12.767636 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8a7ecd6a-54e9-4817-ab66-2e05c19fd4a7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:12.768785 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8a7ecd6a-54e9-4817-ab66-2e05c19fd4a7 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.171670 Nov 02 07:32:12.770195 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 207/403] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:12 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:32:12.839919 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c8e32399-aea6-4c8d-ab65-61fa493e4dab tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:12.847514 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c8e32399-aea6-4c8d-ab65-61fa493e4dab tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1271 microversion: 2.1 time: 0.152224 Nov 02 07:32:12.848075 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 197/404] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:12 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:13.337722 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-b94db342-30ba-4c05-a3b9-24c147420e03 req-0f90a893-5a73-4c57-88b1-bd6d951164e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6e52cf-5d29-406e-bb70-9e84ec9f0bec", "name": "network-vif-plugged", "status": "completed", "tag": "566880a6-3eba-41de-a814-40ba52af43d4"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:32:13.347873 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-b94db342-30ba-4c05-a3b9-24c147420e03 req-0f90a893-5a73-4c57-88b1-bd6d951164e8 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:13.348401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-b94db342-30ba-4c05-a3b9-24c147420e03 req-0f90a893-5a73-4c57-88b1-bd6d951164e8 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:13.348826 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-b94db342-30ba-4c05-a3b9-24c147420e03 req-0f90a893-5a73-4c57-88b1-bd6d951164e8 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:13.360639 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-b94db342-30ba-4c05-a3b9-24c147420e03 req-0f90a893-5a73-4c57-88b1-bd6d951164e8 service nova] Creating event network-vif-plugged:566880a6-3eba-41de-a814-40ba52af43d4 for instance 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec on hv-cinder-80473 Nov 02 07:32:13.365427 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-b94db342-30ba-4c05-a3b9-24c147420e03 req-0f90a893-5a73-4c57-88b1-bd6d951164e8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031432 Nov 02 07:32:13.366231 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 208/405] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:32:13.485039 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c5a17e64-fd91-4568-9c6f-952672a5f770 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:13.485574 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c5a17e64-fd91-4568-9c6f-952672a5f770 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:13.491947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c5a17e64-fd91-4568-9c6f-952672a5f770 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:13.492426 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c5a17e64-fd91-4568-9c6f-952672a5f770 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:13.492858 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c5a17e64-fd91-4568-9c6f-952672a5f770 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:13.493537 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c5a17e64-fd91-4568-9c6f-952672a5f770 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:13.493983 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c5a17e64-fd91-4568-9c6f-952672a5f770 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:13.494423 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c5a17e64-fd91-4568-9c6f-952672a5f770 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:13.681173 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c5a17e64-fd91-4568-9c6f-952672a5f770 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:13.688995 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c5a17e64-fd91-4568-9c6f-952672a5f770 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.208067 Nov 02 07:32:13.689558 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 198/406] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:13 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:13.793839 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-63a06a13-e156-43df-957c-44a80c457aa6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:13.794565 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-63a06a13-e156-43df-957c-44a80c457aa6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:13.801460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-63a06a13-e156-43df-957c-44a80c457aa6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:13.801940 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-63a06a13-e156-43df-957c-44a80c457aa6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:13.802381 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-63a06a13-e156-43df-957c-44a80c457aa6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:13.803084 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-63a06a13-e156-43df-957c-44a80c457aa6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:13.803531 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-63a06a13-e156-43df-957c-44a80c457aa6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:13.803953 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-63a06a13-e156-43df-957c-44a80c457aa6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:13.870158 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d5b862cb-4807-4e7d-9daa-72c266c11754 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:13.871021 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-d5b862cb-4807-4e7d-9daa-72c266c11754 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:13.877645 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d5b862cb-4807-4e7d-9daa-72c266c11754 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:13.878125 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d5b862cb-4807-4e7d-9daa-72c266c11754 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:13.878575 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d5b862cb-4807-4e7d-9daa-72c266c11754 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:13.879256 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d5b862cb-4807-4e7d-9daa-72c266c11754 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:13.879700 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d5b862cb-4807-4e7d-9daa-72c266c11754 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:13.880116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d5b862cb-4807-4e7d-9daa-72c266c11754 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:13.960692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-63a06a13-e156-43df-957c-44a80c457aa6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:13.970064 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-63a06a13-e156-43df-957c-44a80c457aa6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:13.971577 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-63a06a13-e156-43df-957c-44a80c457aa6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:13.972748 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-63a06a13-e156-43df-957c-44a80c457aa6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.183573 Nov 02 07:32:13.973304 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 209/407] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:13 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:32:14.026666 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-d5b862cb-4807-4e7d-9daa-72c266c11754 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:14.035192 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-d5b862cb-4807-4e7d-9daa-72c266c11754 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1271 microversion: 2.1 time: 0.168820 Nov 02 07:32:14.035760 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 199/408] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:13 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:14.711908 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-1835b93f-e929-4784-a9d6-ce3d03016d9e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:14.712511 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-1835b93f-e929-4784-a9d6-ce3d03016d9e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:14.718592 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1835b93f-e929-4784-a9d6-ce3d03016d9e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:14.719070 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1835b93f-e929-4784-a9d6-ce3d03016d9e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:14.719496 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1835b93f-e929-4784-a9d6-ce3d03016d9e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:14.720171 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1835b93f-e929-4784-a9d6-ce3d03016d9e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:14.720612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1835b93f-e929-4784-a9d6-ce3d03016d9e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:14.721031 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1835b93f-e929-4784-a9d6-ce3d03016d9e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:14.861994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-1835b93f-e929-4784-a9d6-ce3d03016d9e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:14.869594 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-1835b93f-e929-4784-a9d6-ce3d03016d9e tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1314 microversion: 2.1 time: 0.161557 Nov 02 07:32:14.870148 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 210/409] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:14 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:14.997491 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e0a23b7c-b2ad-4d19-8030-c033883d5b28 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:14.998026 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e0a23b7c-b2ad-4d19-8030-c033883d5b28 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:15.004676 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e0a23b7c-b2ad-4d19-8030-c033883d5b28 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:15.005158 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e0a23b7c-b2ad-4d19-8030-c033883d5b28 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:15.005589 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e0a23b7c-b2ad-4d19-8030-c033883d5b28 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:15.006304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e0a23b7c-b2ad-4d19-8030-c033883d5b28 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:15.006782 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e0a23b7c-b2ad-4d19-8030-c033883d5b28 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:15.007203 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e0a23b7c-b2ad-4d19-8030-c033883d5b28 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:15.057034 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-138b30d6-6c81-4c2c-8361-02f3d4352f81 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:15.057686 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-138b30d6-6c81-4c2c-8361-02f3d4352f81 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:15.064588 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-138b30d6-6c81-4c2c-8361-02f3d4352f81 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:15.065066 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-138b30d6-6c81-4c2c-8361-02f3d4352f81 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:15.065491 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-138b30d6-6c81-4c2c-8361-02f3d4352f81 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:15.066173 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-138b30d6-6c81-4c2c-8361-02f3d4352f81 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:15.066649 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-138b30d6-6c81-4c2c-8361-02f3d4352f81 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:15.067066 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-138b30d6-6c81-4c2c-8361-02f3d4352f81 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:15.178970 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-e0a23b7c-b2ad-4d19-8030-c033883d5b28 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:15.189241 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-e0a23b7c-b2ad-4d19-8030-c033883d5b28 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:15.190837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-e0a23b7c-b2ad-4d19-8030-c033883d5b28 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:15.192019 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e0a23b7c-b2ad-4d19-8030-c033883d5b28 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.198869 Nov 02 07:32:15.192762 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 200/410] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:14 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:32:15.228473 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-138b30d6-6c81-4c2c-8361-02f3d4352f81 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:15.236981 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-138b30d6-6c81-4c2c-8361-02f3d4352f81 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1271 microversion: 2.1 time: 0.183865 Nov 02 07:32:15.237538 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 211/411] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:15 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1271 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:15.894114 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-5c8f16ad-743b-4af6-a896-c1b9f7320f33 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:15.894856 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-5c8f16ad-743b-4af6-a896-c1b9f7320f33 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:15.896886 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:15.897547 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=6 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:15.898458 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:15.903828 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5c8f16ad-743b-4af6-a896-c1b9f7320f33 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:15.904297 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5c8f16ad-743b-4af6-a896-c1b9f7320f33 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:15.904728 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5c8f16ad-743b-4af6-a896-c1b9f7320f33 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:15.905427 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5c8f16ad-743b-4af6-a896-c1b9f7320f33 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:15.905908 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5c8f16ad-743b-4af6-a896-c1b9f7320f33 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:15.906332 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5c8f16ad-743b-4af6-a896-c1b9f7320f33 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:15.952389 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-7401a6f8-fd58-4eb8-9575-ab9026380b31 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Action: 'create', calling method: .version_select at 0x7f4d6a3be160>, body: {"keypair": {"name": "tempest-keypair-1965427824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXwCTOpVPAKgzWkwAEoJaFK0uP/vCsKTCg1MxvpI0n95Uh4+tiNvwe0NdK/aShr63PS3jW9h+NUDW6Aps1vajyVMUiLnbjV1qXQtaWAuDZTSy8wpNTHTj0ihKLxDPXfxQ=="}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:32:15.961044 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:15.971342 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-7401a6f8-fd58-4eb8-9575-ab9026380b31 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Getting quotas for project ba3bab98d31d49098a8e7242d51be646. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:32:15.975428 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-7401a6f8-fd58-4eb8-9575-ab9026380b31 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Getting quotas for user 47965dc7f5964bbfa4efff0822530965 and project ba3bab98d31d49098a8e7242d51be646. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:32:16.000340 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-7401a6f8-fd58-4eb8-9575-ab9026380b31 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051098 Nov 02 07:32:16.007167 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 212/412] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 07:32:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:32:16.045924 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-5c8f16ad-743b-4af6-a896-c1b9f7320f33 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:16.055320 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-5c8f16ad-743b-4af6-a896-c1b9f7320f33 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1498 microversion: 2.1 time: 0.165179 Nov 02 07:32:16.070105 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 201/413] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:15 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1498 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:16.220842 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f66aeb55-4dbe-488c-a674-974d399e701a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:16.221457 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f66aeb55-4dbe-488c-a674-974d399e701a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:16.229169 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f66aeb55-4dbe-488c-a674-974d399e701a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:16.229576 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f66aeb55-4dbe-488c-a674-974d399e701a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:16.230065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f66aeb55-4dbe-488c-a674-974d399e701a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:16.230814 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f66aeb55-4dbe-488c-a674-974d399e701a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:16.231261 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f66aeb55-4dbe-488c-a674-974d399e701a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:16.231715 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f66aeb55-4dbe-488c-a674-974d399e701a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:16.260344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-fc958ec5-808d-4f8e-a1d8-ea019da02877 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:16.262442 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-fc958ec5-808d-4f8e-a1d8-ea019da02877 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:16.275402 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc958ec5-808d-4f8e-a1d8-ea019da02877 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:16.276313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc958ec5-808d-4f8e-a1d8-ea019da02877 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:16.276808 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc958ec5-808d-4f8e-a1d8-ea019da02877 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:16.277843 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc958ec5-808d-4f8e-a1d8-ea019da02877 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:16.278223 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc958ec5-808d-4f8e-a1d8-ea019da02877 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:16.278687 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc958ec5-808d-4f8e-a1d8-ea019da02877 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:16.467679 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f66aeb55-4dbe-488c-a674-974d399e701a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:16.480969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f66aeb55-4dbe-488c-a674-974d399e701a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:16.484476 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f66aeb55-4dbe-488c-a674-974d399e701a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:16.486346 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f66aeb55-4dbe-488c-a674-974d399e701a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.270258 Nov 02 07:32:16.487383 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 213/414] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:16 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:32:16.523689 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fc958ec5-808d-4f8e-a1d8-ea019da02877 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:16.532628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-fc958ec5-808d-4f8e-a1d8-ea019da02877 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1271 microversion: 2.1 time: 0.277185 Nov 02 07:32:16.533201 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 202/415] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:16 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1271 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:16.996003 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-baa76940-29df-43e9-9810-5a6ce48dac03 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:16.996915 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-baa76940-29df-43e9-9810-5a6ce48dac03 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:17.005090 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-baa76940-29df-43e9-9810-5a6ce48dac03 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:17.005877 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-baa76940-29df-43e9-9810-5a6ce48dac03 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:17.006310 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-baa76940-29df-43e9-9810-5a6ce48dac03 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:17.007028 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-baa76940-29df-43e9-9810-5a6ce48dac03 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:17.007475 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-baa76940-29df-43e9-9810-5a6ce48dac03 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:17.007890 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-baa76940-29df-43e9-9810-5a6ce48dac03 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:17.041027 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-baa76940-29df-43e9-9810-5a6ce48dac03 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Going to try to terminate instance {{(pid=118991) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:32:17.133398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-baa76940-29df-43e9-9810-5a6ce48dac03 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 204 len: 0 microversion: 2.1 time: 0.141165 Nov 02 07:32:17.134511 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 214/416] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:32:16 2022] DELETE /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:32:17.144487 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-592cfd64-462f-40e3-806e-01c4f038a20b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:17.145351 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-592cfd64-462f-40e3-806e-01c4f038a20b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:17.152436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-592cfd64-462f-40e3-806e-01c4f038a20b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:17.152993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-592cfd64-462f-40e3-806e-01c4f038a20b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:17.153516 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-592cfd64-462f-40e3-806e-01c4f038a20b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:17.154268 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-592cfd64-462f-40e3-806e-01c4f038a20b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:17.154812 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-592cfd64-462f-40e3-806e-01c4f038a20b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:17.155578 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-592cfd64-462f-40e3-806e-01c4f038a20b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:17.304631 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-592cfd64-462f-40e3-806e-01c4f038a20b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:17.313467 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-592cfd64-462f-40e3-806e-01c4f038a20b tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1504 microversion: 2.1 time: 0.174052 Nov 02 07:32:17.314036 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 203/417] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:17 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:17.391914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-8963d692-f5ed-4283-bd9a-fdc408853816 req-ba7d961e-8231-472a-bb2a-331521fc3134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae04f42-6d0d-42e5-ae5f-8022b6f546df", "name": "network-vif-plugged", "status": "completed", "tag": "ba58ff3d-570b-447a-86ec-a6d9a70152fc"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:32:17.402286 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-8963d692-f5ed-4283-bd9a-fdc408853816 req-ba7d961e-8231-472a-bb2a-331521fc3134 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:17.403544 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-8963d692-f5ed-4283-bd9a-fdc408853816 req-ba7d961e-8231-472a-bb2a-331521fc3134 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:17.405116 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-8963d692-f5ed-4283-bd9a-fdc408853816 req-ba7d961e-8231-472a-bb2a-331521fc3134 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:17.417374 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1861706820", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db626555-8790-4323-a9e4-7db2e2eaf177"}], "security_groups": [{"name": "tempest-securitygroup--1145946076"}], "key_name": "tempest-keypair-1965427824", "user_data": "}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:32:17.417826 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-8963d692-f5ed-4283-bd9a-fdc408853816 req-ba7d961e-8231-472a-bb2a-331521fc3134 service nova] Creating event network-vif-plugged:ba58ff3d-570b-447a-86ec-a6d9a70152fc for instance cae04f42-6d0d-42e5-ae5f-8022b6f546df on hv-cinder-80473 Nov 02 07:32:17.423936 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-8963d692-f5ed-4283-bd9a-fdc408853816 req-ba7d961e-8231-472a-bb2a-331521fc3134 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037197 Nov 02 07:32:17.424608 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 215/418] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:32:17.512745 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-028bc079-8475-4777-a55d-aad72cb1a971 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:17.513468 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-028bc079-8475-4777-a55d-aad72cb1a971 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:17.520809 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-028bc079-8475-4777-a55d-aad72cb1a971 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:17.521293 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-028bc079-8475-4777-a55d-aad72cb1a971 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:17.521730 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-028bc079-8475-4777-a55d-aad72cb1a971 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:17.522441 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-028bc079-8475-4777-a55d-aad72cb1a971 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:17.522895 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-028bc079-8475-4777-a55d-aad72cb1a971 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:17.523321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-028bc079-8475-4777-a55d-aad72cb1a971 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:17.525039 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.network.neutron [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] validate_networks() for [('db626555-8790-4323-a9e4-7db2e2eaf177', None, None, None, None, None)] {{(pid=118992) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:32:17.722609 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-028bc079-8475-4777-a55d-aad72cb1a971 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:17.731515 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-028bc079-8475-4777-a55d-aad72cb1a971 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:17.733003 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-028bc079-8475-4777-a55d-aad72cb1a971 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:17.734728 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-028bc079-8475-4777-a55d-aad72cb1a971 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.225747 Nov 02 07:32:17.735660 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 216/419] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:17 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:32:17.739859 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-66daa274-3914-4e0a-a93b-1bb0ddbdfab6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:17.740467 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-66daa274-3914-4e0a-a93b-1bb0ddbdfab6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:17.746249 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66daa274-3914-4e0a-a93b-1bb0ddbdfab6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:17.747626 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66daa274-3914-4e0a-a93b-1bb0ddbdfab6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:17.748078 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66daa274-3914-4e0a-a93b-1bb0ddbdfab6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:17.748770 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66daa274-3914-4e0a-a93b-1bb0ddbdfab6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:17.749501 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66daa274-3914-4e0a-a93b-1bb0ddbdfab6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:17.750767 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66daa274-3914-4e0a-a93b-1bb0ddbdfab6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:17.972466 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-66daa274-3914-4e0a-a93b-1bb0ddbdfab6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:17.980011 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-66daa274-3914-4e0a-a93b-1bb0ddbdfab6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1271 microversion: 2.1 time: 0.243619 Nov 02 07:32:17.980571 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 217/420] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:17 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1271 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:18.042255 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Flavor limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:32:18.042721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Image limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:32:18.043183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Flavor pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:32:18.043579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Image pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:32:18.043977 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:32:18.053236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:18.053708 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:18.054132 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:18.054884 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:18.055323 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:18.055740 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:18.071998 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Getting quotas for project ba3bab98d31d49098a8e7242d51be646. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:32:18.075886 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Getting quotas for user 47965dc7f5964bbfa4efff0822530965 and project ba3bab98d31d49098a8e7242d51be646. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:32:18.086658 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Going to run 1 instances... {{(pid=118992) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:32:18.088913 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:32:18.136933 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a9ac7766-5f3e-4957-9d87-1d43667f594b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.723844 Nov 02 07:32:18.137580 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 204/421] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:32:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 07:32:18.148787 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-e46a4de8-ddb9-4190-b0fa-41fdc4d814a9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:18.149392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-e46a4de8-ddb9-4190-b0fa-41fdc4d814a9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:18.206755 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e46a4de8-ddb9-4190-b0fa-41fdc4d814a9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:18.213691 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e46a4de8-ddb9-4190-b0fa-41fdc4d814a9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1242 microversion: 2.1 time: 0.068642 Nov 02 07:32:18.214251 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 218/422] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:18 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:18.337663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-315bff0b-f07c-4ea7-96d8-30ef6ebb2495 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:18.338586 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-315bff0b-f07c-4ea7-96d8-30ef6ebb2495 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:18.345762 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-315bff0b-f07c-4ea7-96d8-30ef6ebb2495 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:18.346242 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-315bff0b-f07c-4ea7-96d8-30ef6ebb2495 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:18.346707 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-315bff0b-f07c-4ea7-96d8-30ef6ebb2495 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:18.347467 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-315bff0b-f07c-4ea7-96d8-30ef6ebb2495 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:18.347903 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-315bff0b-f07c-4ea7-96d8-30ef6ebb2495 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:18.348485 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-315bff0b-f07c-4ea7-96d8-30ef6ebb2495 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:18.488235 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-315bff0b-f07c-4ea7-96d8-30ef6ebb2495 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:18.502332 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-315bff0b-f07c-4ea7-96d8-30ef6ebb2495 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1504 microversion: 2.1 time: 0.168940 Nov 02 07:32:18.512287 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 205/423] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:18 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:18.761055 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b3f8767a-cc9f-4bff-a27b-c0a152bf6e52 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:18.761674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b3f8767a-cc9f-4bff-a27b-c0a152bf6e52 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:18.768366 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b3f8767a-cc9f-4bff-a27b-c0a152bf6e52 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:18.768849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b3f8767a-cc9f-4bff-a27b-c0a152bf6e52 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:18.769282 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b3f8767a-cc9f-4bff-a27b-c0a152bf6e52 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:18.769969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b3f8767a-cc9f-4bff-a27b-c0a152bf6e52 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:18.770457 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b3f8767a-cc9f-4bff-a27b-c0a152bf6e52 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:18.770887 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b3f8767a-cc9f-4bff-a27b-c0a152bf6e52 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:18.777566 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:18.905790 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b3f8767a-cc9f-4bff-a27b-c0a152bf6e52 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:18.914316 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b3f8767a-cc9f-4bff-a27b-c0a152bf6e52 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:18.915757 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b3f8767a-cc9f-4bff-a27b-c0a152bf6e52 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:18.916893 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b3f8767a-cc9f-4bff-a27b-c0a152bf6e52 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.159713 Nov 02 07:32:18.917438 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 219/424] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:18 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:32:19.003825 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7fa9df73-ecba-4c26-9ca9-f55876b2e787 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:19.004541 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-7fa9df73-ecba-4c26-9ca9-f55876b2e787 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:19.010532 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7fa9df73-ecba-4c26-9ca9-f55876b2e787 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:19.011014 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7fa9df73-ecba-4c26-9ca9-f55876b2e787 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:19.011497 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7fa9df73-ecba-4c26-9ca9-f55876b2e787 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:19.012121 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7fa9df73-ecba-4c26-9ca9-f55876b2e787 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:19.012571 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7fa9df73-ecba-4c26-9ca9-f55876b2e787 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:19.012992 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7fa9df73-ecba-4c26-9ca9-f55876b2e787 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:19.143075 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-7fa9df73-ecba-4c26-9ca9-f55876b2e787 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:19.151427 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-7fa9df73-ecba-4c26-9ca9-f55876b2e787 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1259 microversion: 2.1 time: 0.151931 Nov 02 07:32:19.152230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 206/425] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:18 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:19.236242 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-cc9b4b2e-91c8-405c-a483-4d40459710e2 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:19.236848 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-cc9b4b2e-91c8-405c-a483-4d40459710e2 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:19.243487 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cc9b4b2e-91c8-405c-a483-4d40459710e2 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:19.243961 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cc9b4b2e-91c8-405c-a483-4d40459710e2 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:19.244388 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cc9b4b2e-91c8-405c-a483-4d40459710e2 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:19.245064 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cc9b4b2e-91c8-405c-a483-4d40459710e2 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:19.245510 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cc9b4b2e-91c8-405c-a483-4d40459710e2 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:19.245931 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cc9b4b2e-91c8-405c-a483-4d40459710e2 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:19.311669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-cc9b4b2e-91c8-405c-a483-4d40459710e2 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:19.319995 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-cc9b4b2e-91c8-405c-a483-4d40459710e2 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1246 microversion: 2.1 time: 0.087778 Nov 02 07:32:19.320552 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 220/426] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:19 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:19.535876 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1e790572-b441-4489-80cb-ab4bf1f8ccfd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:19.536550 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1e790572-b441-4489-80cb-ab4bf1f8ccfd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:19.549784 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e790572-b441-4489-80cb-ab4bf1f8ccfd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:19.550284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e790572-b441-4489-80cb-ab4bf1f8ccfd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:19.550759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e790572-b441-4489-80cb-ab4bf1f8ccfd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:19.551460 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e790572-b441-4489-80cb-ab4bf1f8ccfd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:19.551916 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e790572-b441-4489-80cb-ab4bf1f8ccfd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:19.552336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e790572-b441-4489-80cb-ab4bf1f8ccfd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:19.768207 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1e790572-b441-4489-80cb-ab4bf1f8ccfd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:19.776180 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-1e790572-b441-4489-80cb-ab4bf1f8ccfd tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1504 microversion: 2.1 time: 0.244103 Nov 02 07:32:19.776741 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 207/427] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:19 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:19.943066 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5bfd3b1e-01c3-4eea-b479-eca9ccd3f40e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:19.944674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-5bfd3b1e-01c3-4eea-b479-eca9ccd3f40e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:19.952388 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5bfd3b1e-01c3-4eea-b479-eca9ccd3f40e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:19.953716 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5bfd3b1e-01c3-4eea-b479-eca9ccd3f40e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:19.954182 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5bfd3b1e-01c3-4eea-b479-eca9ccd3f40e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:19.955093 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5bfd3b1e-01c3-4eea-b479-eca9ccd3f40e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:19.955892 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5bfd3b1e-01c3-4eea-b479-eca9ccd3f40e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:19.956390 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5bfd3b1e-01c3-4eea-b479-eca9ccd3f40e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:20.017972 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-99554cda-1058-4f05-b075-5040fec3061b req-69a5f7ee-d127-4c08-be17-9ab36008a729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6e52cf-5d29-406e-bb70-9e84ec9f0bec", "name": "network-vif-deleted", "tag": "566880a6-3eba-41de-a814-40ba52af43d4"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:32:20.027954 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-99554cda-1058-4f05-b075-5040fec3061b req-69a5f7ee-d127-4c08-be17-9ab36008a729 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:20.028429 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-99554cda-1058-4f05-b075-5040fec3061b req-69a5f7ee-d127-4c08-be17-9ab36008a729 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:20.028861 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-99554cda-1058-4f05-b075-5040fec3061b req-69a5f7ee-d127-4c08-be17-9ab36008a729 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:20.040891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-99554cda-1058-4f05-b075-5040fec3061b req-69a5f7ee-d127-4c08-be17-9ab36008a729 service nova] Creating event network-vif-deleted:566880a6-3eba-41de-a814-40ba52af43d4 for instance 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec on hv-cinder-80473 Nov 02 07:32:20.045930 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-99554cda-1058-4f05-b075-5040fec3061b req-69a5f7ee-d127-4c08-be17-9ab36008a729 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032230 Nov 02 07:32:20.047333 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 208/428] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:32:20.116098 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-5bfd3b1e-01c3-4eea-b479-eca9ccd3f40e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:20.124883 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-5bfd3b1e-01c3-4eea-b479-eca9ccd3f40e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:20.126310 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-5bfd3b1e-01c3-4eea-b479-eca9ccd3f40e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:20.127484 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-5bfd3b1e-01c3-4eea-b479-eca9ccd3f40e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.189936 Nov 02 07:32:20.128031 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 221/429] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:19 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:32:20.175764 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3d5cc644-908f-4a4a-a999-3a5053b61dff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:20.176447 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3d5cc644-908f-4a4a-a999-3a5053b61dff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:20.182576 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d5cc644-908f-4a4a-a999-3a5053b61dff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:20.183048 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d5cc644-908f-4a4a-a999-3a5053b61dff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:20.183474 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d5cc644-908f-4a4a-a999-3a5053b61dff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:20.184178 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d5cc644-908f-4a4a-a999-3a5053b61dff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:20.184618 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d5cc644-908f-4a4a-a999-3a5053b61dff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:20.185046 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3d5cc644-908f-4a4a-a999-3a5053b61dff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:20.319360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3d5cc644-908f-4a4a-a999-3a5053b61dff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:20.326949 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3d5cc644-908f-4a4a-a999-3a5053b61dff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1259 microversion: 2.1 time: 0.155408 Nov 02 07:32:20.327506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 209/430] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:20 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:20.343022 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-07a31677-ae28-4e0f-85c9-1e8091deaec9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:20.343807 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-07a31677-ae28-4e0f-85c9-1e8091deaec9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:20.350174 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07a31677-ae28-4e0f-85c9-1e8091deaec9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:20.350692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07a31677-ae28-4e0f-85c9-1e8091deaec9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:20.351124 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07a31677-ae28-4e0f-85c9-1e8091deaec9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:20.351802 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07a31677-ae28-4e0f-85c9-1e8091deaec9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:20.352251 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07a31677-ae28-4e0f-85c9-1e8091deaec9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:20.352671 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07a31677-ae28-4e0f-85c9-1e8091deaec9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:20.416848 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-07a31677-ae28-4e0f-85c9-1e8091deaec9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:20.426214 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-07a31677-ae28-4e0f-85c9-1e8091deaec9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1294 microversion: 2.1 time: 0.086941 Nov 02 07:32:20.427396 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 222/431] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:20 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:20.800162 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-fd870b54-b52c-4a6e-ad17-f6ab8837c1e9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:20.800805 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-fd870b54-b52c-4a6e-ad17-f6ab8837c1e9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:20.807210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd870b54-b52c-4a6e-ad17-f6ab8837c1e9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:20.807724 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd870b54-b52c-4a6e-ad17-f6ab8837c1e9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:20.808125 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd870b54-b52c-4a6e-ad17-f6ab8837c1e9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:20.808802 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd870b54-b52c-4a6e-ad17-f6ab8837c1e9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:20.809253 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd870b54-b52c-4a6e-ad17-f6ab8837c1e9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:20.809672 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd870b54-b52c-4a6e-ad17-f6ab8837c1e9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:20.840106 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd870b54-b52c-4a6e-ad17-f6ab8837c1e9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:20.840506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd870b54-b52c-4a6e-ad17-f6ab8837c1e9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:20.840932 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd870b54-b52c-4a6e-ad17-f6ab8837c1e9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:20.841368 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-fd870b54-b52c-4a6e-ad17-f6ab8837c1e9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lazy-loading 'fault' on Instance uuid 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:32:20.882054 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fd870b54-b52c-4a6e-ad17-f6ab8837c1e9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:20.889604 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-fd870b54-b52c-4a6e-ad17-f6ab8837c1e9 tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1304 microversion: 2.1 time: 0.093973 Nov 02 07:32:20.891670 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 210/432] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:20 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:21.153949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-6c7dd5ea-8010-4219-8dfd-ec0b8ac2a1ae tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:21.154608 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-6c7dd5ea-8010-4219-8dfd-ec0b8ac2a1ae tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:21.161293 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6c7dd5ea-8010-4219-8dfd-ec0b8ac2a1ae tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:21.161779 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6c7dd5ea-8010-4219-8dfd-ec0b8ac2a1ae tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:21.162478 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6c7dd5ea-8010-4219-8dfd-ec0b8ac2a1ae tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:21.163189 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6c7dd5ea-8010-4219-8dfd-ec0b8ac2a1ae tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:21.163647 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6c7dd5ea-8010-4219-8dfd-ec0b8ac2a1ae tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:21.164073 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6c7dd5ea-8010-4219-8dfd-ec0b8ac2a1ae tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:21.308882 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-6c7dd5ea-8010-4219-8dfd-ec0b8ac2a1ae tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:21.319333 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-6c7dd5ea-8010-4219-8dfd-ec0b8ac2a1ae tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:21.320954 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-6c7dd5ea-8010-4219-8dfd-ec0b8ac2a1ae tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:21.322194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-6c7dd5ea-8010-4219-8dfd-ec0b8ac2a1ae tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1807 microversion: 2.20 time: 0.173065 Nov 02 07:32:21.323210 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 223/433] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:21 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:32:21.351053 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-af88abe7-6efe-4cf9-8c46-b4128f0de7c6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:21.351766 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-af88abe7-6efe-4cf9-8c46-b4128f0de7c6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:21.357997 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af88abe7-6efe-4cf9-8c46-b4128f0de7c6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:21.358679 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af88abe7-6efe-4cf9-8c46-b4128f0de7c6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:21.359661 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af88abe7-6efe-4cf9-8c46-b4128f0de7c6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:21.360540 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af88abe7-6efe-4cf9-8c46-b4128f0de7c6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:21.360987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af88abe7-6efe-4cf9-8c46-b4128f0de7c6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:21.361404 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af88abe7-6efe-4cf9-8c46-b4128f0de7c6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:21.456040 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-992f5908-58f3-4bee-9f66-d597924b7e60 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:21.457229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-992f5908-58f3-4bee-9f66-d597924b7e60 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:21.463801 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-992f5908-58f3-4bee-9f66-d597924b7e60 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:21.464516 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-992f5908-58f3-4bee-9f66-d597924b7e60 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:21.464955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-992f5908-58f3-4bee-9f66-d597924b7e60 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:21.465666 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-992f5908-58f3-4bee-9f66-d597924b7e60 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:21.466259 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-992f5908-58f3-4bee-9f66-d597924b7e60 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:21.466878 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-992f5908-58f3-4bee-9f66-d597924b7e60 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:21.507469 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-af88abe7-6efe-4cf9-8c46-b4128f0de7c6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:21.517641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-af88abe7-6efe-4cf9-8c46-b4128f0de7c6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1259 microversion: 2.1 time: 0.170276 Nov 02 07:32:21.518452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 211/434] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:21 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:21.538790 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-992f5908-58f3-4bee-9f66-d597924b7e60 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:21.547640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-992f5908-58f3-4bee-9f66-d597924b7e60 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1302 microversion: 2.1 time: 0.096187 Nov 02 07:32:21.548194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 224/435] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:21 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1302 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:21.918062 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-70d72873-bbb5-485c-adeb-9a2ccaaf9cee tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:21.919846 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-70d72873-bbb5-485c-adeb-9a2ccaaf9cee tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:21.928539 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-70d72873-bbb5-485c-adeb-9a2ccaaf9cee tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:21.929443 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-70d72873-bbb5-485c-adeb-9a2ccaaf9cee tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:21.930055 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-70d72873-bbb5-485c-adeb-9a2ccaaf9cee tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:21.932460 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-70d72873-bbb5-485c-adeb-9a2ccaaf9cee tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:21.933081 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-70d72873-bbb5-485c-adeb-9a2ccaaf9cee tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:21.934151 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-70d72873-bbb5-485c-adeb-9a2ccaaf9cee tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:21.979103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-70d72873-bbb5-485c-adeb-9a2ccaaf9cee tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:21.979618 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-70d72873-bbb5-485c-adeb-9a2ccaaf9cee tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:21.980349 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-70d72873-bbb5-485c-adeb-9a2ccaaf9cee tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:21.980876 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-70d72873-bbb5-485c-adeb-9a2ccaaf9cee tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lazy-loading 'fault' on Instance uuid 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:32:22.023473 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-70d72873-bbb5-485c-adeb-9a2ccaaf9cee tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b55941561934c818a2b5eb2c9a19d22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155356fb94b74eaba3a8465d1a1f21ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:22.031930 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-70d72873-bbb5-485c-adeb-9a2ccaaf9cee tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 200 len: 1304 microversion: 2.1 time: 0.121885 Nov 02 07:32:22.032510 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 212/436] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:21 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:22.348348 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2b218319-44fe-4ef0-8885-7e62a4fd06c2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:22.348956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2b218319-44fe-4ef0-8885-7e62a4fd06c2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:22.355506 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2b218319-44fe-4ef0-8885-7e62a4fd06c2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:22.355987 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2b218319-44fe-4ef0-8885-7e62a4fd06c2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:22.356418 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2b218319-44fe-4ef0-8885-7e62a4fd06c2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:22.357106 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2b218319-44fe-4ef0-8885-7e62a4fd06c2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:22.357630 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2b218319-44fe-4ef0-8885-7e62a4fd06c2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:22.357972 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2b218319-44fe-4ef0-8885-7e62a4fd06c2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:22.540889 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-eab7603b-0ad9-4e40-af0c-6e8d5d6afb35 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:22.541506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-eab7603b-0ad9-4e40-af0c-6e8d5d6afb35 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:22.547816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eab7603b-0ad9-4e40-af0c-6e8d5d6afb35 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:22.548339 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eab7603b-0ad9-4e40-af0c-6e8d5d6afb35 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:22.548777 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eab7603b-0ad9-4e40-af0c-6e8d5d6afb35 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:22.549468 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eab7603b-0ad9-4e40-af0c-6e8d5d6afb35 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:22.549925 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eab7603b-0ad9-4e40-af0c-6e8d5d6afb35 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:22.550353 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eab7603b-0ad9-4e40-af0c-6e8d5d6afb35 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:22.570266 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2b218319-44fe-4ef0-8885-7e62a4fd06c2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:22.579976 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2b218319-44fe-4ef0-8885-7e62a4fd06c2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:22.581800 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2b218319-44fe-4ef0-8885-7e62a4fd06c2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:22.583098 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2b218319-44fe-4ef0-8885-7e62a4fd06c2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1794 microversion: 2.20 time: 0.239410 Nov 02 07:32:22.583733 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 225/437] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:32:22 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1794 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:32:22.588176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b82df662-0363-4622-808f-8d46fe1eefb1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:22.588780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b82df662-0363-4622-808f-8d46fe1eefb1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:22.595722 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b82df662-0363-4622-808f-8d46fe1eefb1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:22.596498 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b82df662-0363-4622-808f-8d46fe1eefb1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:22.597617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b82df662-0363-4622-808f-8d46fe1eefb1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:22.598576 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b82df662-0363-4622-808f-8d46fe1eefb1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:22.599262 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b82df662-0363-4622-808f-8d46fe1eefb1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:22.599893 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b82df662-0363-4622-808f-8d46fe1eefb1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:22.703472 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b82df662-0363-4622-808f-8d46fe1eefb1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:22.712550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b82df662-0363-4622-808f-8d46fe1eefb1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1300 microversion: 2.1 time: 0.127775 Nov 02 07:32:22.713127 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 226/438] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:22 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1300 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:22.802202 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-eab7603b-0ad9-4e40-af0c-6e8d5d6afb35 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:22.810821 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-eab7603b-0ad9-4e40-af0c-6e8d5d6afb35 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1259 microversion: 2.1 time: 0.273685 Nov 02 07:32:22.811396 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 213/439] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:22 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1259 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:23.055640 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0a3a6689-32a1-4046-b49e-3e2d36d01cad tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:23.056154 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-0a3a6689-32a1-4046-b49e-3e2d36d01cad tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] [instance: 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:23.062809 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0a3a6689-32a1-4046-b49e-3e2d36d01cad tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:23.063294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0a3a6689-32a1-4046-b49e-3e2d36d01cad tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:23.063721 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0a3a6689-32a1-4046-b49e-3e2d36d01cad tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:23.064409 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0a3a6689-32a1-4046-b49e-3e2d36d01cad tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:23.064854 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0a3a6689-32a1-4046-b49e-3e2d36d01cad tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:23.065270 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0a3a6689-32a1-4046-b49e-3e2d36d01cad tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:23.080939 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-0a3a6689-32a1-4046-b49e-3e2d36d01cad tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] HTTP exception thrown: Instance 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec could not be found. Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0a3a6689-32a1-4046-b49e-3e2d36d01cad tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Request method failure captured: Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec HTTP/1.1 Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhzDFVNrRsipe4hVl3zTVPXXvVM8yerROqByxQorQ18wf-0EFpR3qWcmGF0K1j3BeqG_ThkAICcMHMu_jaop5hL-Bl1J8qFSCQqM1FJGtlT0UF1F9jrTaaalFzykuf3kUVi5Gj9hVpT_mqiCUlUIB-ewLE_OMYrFGdWGD6o_ra2A0ug Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: 155356fb94b74eaba3a8465d1a1f21ff Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-VolumesActionsTest-994650783 Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:32:23.083694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:32:23.085050 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_155356fb94b74eaba3a8465d1a1f21ff", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/155356fb94b74eaba3a8465d1a1f21ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/155356fb94b74eaba3a8465d1a1f21ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/155356fb94b74eaba3a8465d1a1f21ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:32:23.085050 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-VolumesActionsTest-994650783 Nov 02 07:32:23.085050 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: 155356fb94b74eaba3a8465d1a1f21ff Nov 02 07:32:23.085050 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-VolumesActionsTest-994650783 Nov 02 07:32:23.085050 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-VolumesActionsTest-994650783-project Nov 02 07:32:23.085050 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:32:23.085050 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:32:23.085050 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 0b55941561934c818a2b5eb2c9a19d22 Nov 02 07:32:23.085050 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-VolumesActionsTest-994650783-project Nov 02 07:32:23.085050 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:32:23.085050 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec could not be found. Nov 02 07:32:23.085050 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': '5c6e52cf-5d29-406e-bb70-9e84ec9f0bec'} Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec could not be found. Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:32:23.086059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec could not be found. Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec could not be found. Nov 02 07:32:23.087351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:32:23.088600 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0a3a6689-32a1-4046-b49e-3e2d36d01cad tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] Returning 404 to user: Instance 5c6e52cf-5d29-406e-bb70-9e84ec9f0bec could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:32:23.088600 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0a3a6689-32a1-4046-b49e-3e2d36d01cad tempest-VolumesActionsTest-994650783 tempest-VolumesActionsTest-994650783-project] 10.222.0.18 "GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec" status: 404 len: 111 microversion: 2.1 time: 0.033356 Nov 02 07:32:23.089597 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 227/440] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:23 2022] GET /compute/v2.1/servers/5c6e52cf-5d29-406e-bb70-9e84ec9f0bec => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:32:23.688097 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-cac697c6-dc02-4a43-b4fa-34f7066cdd92 req-655ebed3-ecdf-4d95-b753-27e85684c941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a9cfaf-8301-4add-a31e-805734cc8ad3", "tag": "dae949dc-142c-4367-baec-04935624813b"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:32:23.698406 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-cac697c6-dc02-4a43-b4fa-34f7066cdd92 req-655ebed3-ecdf-4d95-b753-27e85684c941 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:23.698946 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-cac697c6-dc02-4a43-b4fa-34f7066cdd92 req-655ebed3-ecdf-4d95-b753-27e85684c941 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:23.699375 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-cac697c6-dc02-4a43-b4fa-34f7066cdd92 req-655ebed3-ecdf-4d95-b753-27e85684c941 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:23.713807 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-cac697c6-dc02-4a43-b4fa-34f7066cdd92 req-655ebed3-ecdf-4d95-b753-27e85684c941 service nova] Creating event network-changed:dae949dc-142c-4367-baec-04935624813b for instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 on hv-cinder-80473 Nov 02 07:32:23.720321 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-cac697c6-dc02-4a43-b4fa-34f7066cdd92 req-655ebed3-ecdf-4d95-b753-27e85684c941 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037409 Nov 02 07:32:23.721137 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 214/441] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:32:23.736526 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5a43be36-d525-4f97-a911-cd179f1dcd6c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:23.737274 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-5a43be36-d525-4f97-a911-cd179f1dcd6c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:23.745268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5a43be36-d525-4f97-a911-cd179f1dcd6c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:23.745450 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5a43be36-d525-4f97-a911-cd179f1dcd6c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:23.745780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5a43be36-d525-4f97-a911-cd179f1dcd6c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:23.746800 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5a43be36-d525-4f97-a911-cd179f1dcd6c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:23.747261 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5a43be36-d525-4f97-a911-cd179f1dcd6c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:23.747693 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5a43be36-d525-4f97-a911-cd179f1dcd6c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:23.835119 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-61ed5ab8-fdd7-46f0-bad7-e8414809bc12 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:23.835897 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-61ed5ab8-fdd7-46f0-bad7-e8414809bc12 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:23.842442 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-61ed5ab8-fdd7-46f0-bad7-e8414809bc12 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:23.844255 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-61ed5ab8-fdd7-46f0-bad7-e8414809bc12 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:23.844871 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-61ed5ab8-fdd7-46f0-bad7-e8414809bc12 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:23.845714 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-61ed5ab8-fdd7-46f0-bad7-e8414809bc12 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:23.846158 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-61ed5ab8-fdd7-46f0-bad7-e8414809bc12 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:23.846672 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-61ed5ab8-fdd7-46f0-bad7-e8414809bc12 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:23.851789 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=100 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:24.017323 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-5a43be36-d525-4f97-a911-cd179f1dcd6c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:24.025112 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-5a43be36-d525-4f97-a911-cd179f1dcd6c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1368 microversion: 2.1 time: 0.293348 Nov 02 07:32:24.025860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 228/442] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:23 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1368 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:24.110491 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-61ed5ab8-fdd7-46f0-bad7-e8414809bc12 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:24.118197 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-61ed5ab8-fdd7-46f0-bad7-e8414809bc12 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1259 microversion: 2.1 time: 0.287614 Nov 02 07:32:24.118871 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 215/443] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:23 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1259 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:25.048345 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-e10278c6-bbb7-480d-afd2-98a2e4a4e7cc tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:25.048962 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-e10278c6-bbb7-480d-afd2-98a2e4a4e7cc tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:25.055279 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e10278c6-bbb7-480d-afd2-98a2e4a4e7cc tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:25.055750 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e10278c6-bbb7-480d-afd2-98a2e4a4e7cc tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:25.056174 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e10278c6-bbb7-480d-afd2-98a2e4a4e7cc tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:25.056847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e10278c6-bbb7-480d-afd2-98a2e4a4e7cc tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:25.057289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e10278c6-bbb7-480d-afd2-98a2e4a4e7cc tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:25.057705 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e10278c6-bbb7-480d-afd2-98a2e4a4e7cc tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:25.141268 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c38f1146-5b57-4fd4-a41f-b60cd819c264 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:25.141905 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c38f1146-5b57-4fd4-a41f-b60cd819c264 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:25.148348 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c38f1146-5b57-4fd4-a41f-b60cd819c264 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:25.148974 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c38f1146-5b57-4fd4-a41f-b60cd819c264 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:25.149413 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c38f1146-5b57-4fd4-a41f-b60cd819c264 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:25.150098 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c38f1146-5b57-4fd4-a41f-b60cd819c264 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:25.150570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c38f1146-5b57-4fd4-a41f-b60cd819c264 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:25.150989 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c38f1146-5b57-4fd4-a41f-b60cd819c264 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:25.480567 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e10278c6-bbb7-480d-afd2-98a2e4a4e7cc tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:25.489282 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e10278c6-bbb7-480d-afd2-98a2e4a4e7cc tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1368 microversion: 2.1 time: 0.444699 Nov 02 07:32:25.489857 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 229/444] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:25 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1368 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:25.527873 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c38f1146-5b57-4fd4-a41f-b60cd819c264 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:25.536220 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c38f1146-5b57-4fd4-a41f-b60cd819c264 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1259 microversion: 2.1 time: 0.398901 Nov 02 07:32:25.536783 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 216/445] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:25 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1259 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:26.512146 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8c310272-c1e3-4b79-9211-63cabbaaf784 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:26.512775 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8c310272-c1e3-4b79-9211-63cabbaaf784 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:26.520310 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8c310272-c1e3-4b79-9211-63cabbaaf784 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:26.521132 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8c310272-c1e3-4b79-9211-63cabbaaf784 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:26.521793 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8c310272-c1e3-4b79-9211-63cabbaaf784 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:26.522522 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8c310272-c1e3-4b79-9211-63cabbaaf784 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:26.522976 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8c310272-c1e3-4b79-9211-63cabbaaf784 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:26.523397 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8c310272-c1e3-4b79-9211-63cabbaaf784 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:26.559225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a5d31a6d-9a3a-4c04-9f7b-b25d24321a3f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:26.559830 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a5d31a6d-9a3a-4c04-9f7b-b25d24321a3f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:26.566522 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a5d31a6d-9a3a-4c04-9f7b-b25d24321a3f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:26.566997 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a5d31a6d-9a3a-4c04-9f7b-b25d24321a3f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:26.567419 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a5d31a6d-9a3a-4c04-9f7b-b25d24321a3f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:26.568103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a5d31a6d-9a3a-4c04-9f7b-b25d24321a3f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:26.568541 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a5d31a6d-9a3a-4c04-9f7b-b25d24321a3f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:26.568953 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a5d31a6d-9a3a-4c04-9f7b-b25d24321a3f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:26.705394 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8c310272-c1e3-4b79-9211-63cabbaaf784 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:26.712924 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8c310272-c1e3-4b79-9211-63cabbaaf784 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1368 microversion: 2.1 time: 0.204617 Nov 02 07:32:26.713478 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 230/446] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:26 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:26.731876 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a5d31a6d-9a3a-4c04-9f7b-b25d24321a3f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:26.740056 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a5d31a6d-9a3a-4c04-9f7b-b25d24321a3f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1259 microversion: 2.1 time: 0.184539 Nov 02 07:32:26.740615 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 217/447] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:26 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:27.737327 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c67accac-beb8-4263-82e1-86d69e12b7a3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:27.737978 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c67accac-beb8-4263-82e1-86d69e12b7a3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:27.744471 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c67accac-beb8-4263-82e1-86d69e12b7a3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:27.744945 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c67accac-beb8-4263-82e1-86d69e12b7a3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:27.745373 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c67accac-beb8-4263-82e1-86d69e12b7a3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:27.746156 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c67accac-beb8-4263-82e1-86d69e12b7a3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:27.746903 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c67accac-beb8-4263-82e1-86d69e12b7a3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:27.747318 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c67accac-beb8-4263-82e1-86d69e12b7a3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:27.763157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e10d416a-ccaf-4746-acb4-ccf5fa9de4af tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:27.763801 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e10d416a-ccaf-4746-acb4-ccf5fa9de4af tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:27.770119 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e10d416a-ccaf-4746-acb4-ccf5fa9de4af tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:27.770637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e10d416a-ccaf-4746-acb4-ccf5fa9de4af tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:27.771059 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e10d416a-ccaf-4746-acb4-ccf5fa9de4af tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:27.771740 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e10d416a-ccaf-4746-acb4-ccf5fa9de4af tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:27.772184 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e10d416a-ccaf-4746-acb4-ccf5fa9de4af tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:27.772597 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e10d416a-ccaf-4746-acb4-ccf5fa9de4af tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:27.943329 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c67accac-beb8-4263-82e1-86d69e12b7a3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:27.951162 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c67accac-beb8-4263-82e1-86d69e12b7a3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1368 microversion: 2.1 time: 0.218311 Nov 02 07:32:27.951604 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-e10d416a-ccaf-4746-acb4-ccf5fa9de4af tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:27.951869 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 231/448] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:27 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:27.960047 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e10d416a-ccaf-4746-acb4-ccf5fa9de4af tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1259 microversion: 2.1 time: 0.200630 Nov 02 07:32:27.960612 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 218/449] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:27 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:28.983728 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-adb3b314-53a6-447f-baf2-61848d0c4c2b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:28.983728 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-adb3b314-53a6-447f-baf2-61848d0c4c2b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:28.988745 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-11e9bd87-86d2-4fc0-809b-ca4fa2712204 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:28.990038 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-11e9bd87-86d2-4fc0-809b-ca4fa2712204 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:28.992157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:28.996125 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=6 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:29.003317 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=6 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:29.009109 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-11e9bd87-86d2-4fc0-809b-ca4fa2712204 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:29.009609 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-11e9bd87-86d2-4fc0-809b-ca4fa2712204 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:29.011607 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-adb3b314-53a6-447f-baf2-61848d0c4c2b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:29.012249 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-11e9bd87-86d2-4fc0-809b-ca4fa2712204 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:29.013010 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-adb3b314-53a6-447f-baf2-61848d0c4c2b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:29.013893 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-11e9bd87-86d2-4fc0-809b-ca4fa2712204 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:29.014564 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-adb3b314-53a6-447f-baf2-61848d0c4c2b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:29.015345 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-adb3b314-53a6-447f-baf2-61848d0c4c2b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:29.015932 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-adb3b314-53a6-447f-baf2-61848d0c4c2b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:29.016371 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-adb3b314-53a6-447f-baf2-61848d0c4c2b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:29.018731 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-11e9bd87-86d2-4fc0-809b-ca4fa2712204 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:29.019352 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-11e9bd87-86d2-4fc0-809b-ca4fa2712204 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:29.253222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-adb3b314-53a6-447f-baf2-61848d0c4c2b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:29.261047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-11e9bd87-86d2-4fc0-809b-ca4fa2712204 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:29.282951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-adb3b314-53a6-447f-baf2-61848d0c4c2b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1259 microversion: 2.1 time: 0.304016 Nov 02 07:32:29.285276 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-11e9bd87-86d2-4fc0-809b-ca4fa2712204 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1368 microversion: 2.1 time: 0.311586 Nov 02 07:32:29.287165 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 232/450] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:28 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1368 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:29.304702 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 219/451] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:28 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1259 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:30.309719 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2f559c6d-ac69-441a-9bff-7b175e85f88a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:30.310246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2f559c6d-ac69-441a-9bff-7b175e85f88a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:30.315098 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-bdfffbb7-31ed-4fc4-b4a8-6a536825939a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:30.316417 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-bdfffbb7-31ed-4fc4-b4a8-6a536825939a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:30.320643 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2f559c6d-ac69-441a-9bff-7b175e85f88a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:30.324641 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2f559c6d-ac69-441a-9bff-7b175e85f88a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:30.325144 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2f559c6d-ac69-441a-9bff-7b175e85f88a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:30.325870 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2f559c6d-ac69-441a-9bff-7b175e85f88a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:30.328410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2f559c6d-ac69-441a-9bff-7b175e85f88a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:30.329500 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2f559c6d-ac69-441a-9bff-7b175e85f88a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:30.332337 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bdfffbb7-31ed-4fc4-b4a8-6a536825939a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:30.335647 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bdfffbb7-31ed-4fc4-b4a8-6a536825939a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:30.336862 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bdfffbb7-31ed-4fc4-b4a8-6a536825939a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:30.338128 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bdfffbb7-31ed-4fc4-b4a8-6a536825939a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:30.339188 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bdfffbb7-31ed-4fc4-b4a8-6a536825939a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:30.339883 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bdfffbb7-31ed-4fc4-b4a8-6a536825939a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:30.544887 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-bdfffbb7-31ed-4fc4-b4a8-6a536825939a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:30.549452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2f559c6d-ac69-441a-9bff-7b175e85f88a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:30.554695 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-bdfffbb7-31ed-4fc4-b4a8-6a536825939a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1259 microversion: 2.1 time: 0.244385 Nov 02 07:32:30.555987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 220/452] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:30 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1259 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:30.559092 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2f559c6d-ac69-441a-9bff-7b175e85f88a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1368 microversion: 2.1 time: 0.253395 Nov 02 07:32:30.559666 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 233/453] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:30 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:31.579499 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a90c9cf2-5aed-4406-9d7a-55d395f6ea15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:31.580116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a90c9cf2-5aed-4406-9d7a-55d395f6ea15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:31.584558 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-559cf18c-86c4-4459-83c7-dfc155258bd7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:31.585246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-559cf18c-86c4-4459-83c7-dfc155258bd7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:31.590769 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a90c9cf2-5aed-4406-9d7a-55d395f6ea15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:31.591270 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a90c9cf2-5aed-4406-9d7a-55d395f6ea15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:31.591710 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a90c9cf2-5aed-4406-9d7a-55d395f6ea15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:31.592407 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a90c9cf2-5aed-4406-9d7a-55d395f6ea15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:31.592740 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-559cf18c-86c4-4459-83c7-dfc155258bd7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:31.594407 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-559cf18c-86c4-4459-83c7-dfc155258bd7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:31.594955 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a90c9cf2-5aed-4406-9d7a-55d395f6ea15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:31.595391 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a90c9cf2-5aed-4406-9d7a-55d395f6ea15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:31.595839 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-559cf18c-86c4-4459-83c7-dfc155258bd7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:31.596752 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-559cf18c-86c4-4459-83c7-dfc155258bd7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:31.597279 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-559cf18c-86c4-4459-83c7-dfc155258bd7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:31.597784 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-559cf18c-86c4-4459-83c7-dfc155258bd7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:31.836801 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a90c9cf2-5aed-4406-9d7a-55d395f6ea15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:31.846177 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a90c9cf2-5aed-4406-9d7a-55d395f6ea15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1259 microversion: 2.1 time: 0.271308 Nov 02 07:32:31.847891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 221/454] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:31 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1259 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:31.853044 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-2de5b585-05f6-462a-a8dd-0a44bef9fd1a req-2507ad17-1fb3-4892-b869-2c1b3b076db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ad3728-5dee-49b1-a62d-3bdfca6b47ce", "name": "network-vif-plugged", "status": "completed", "tag": "697a5305-479b-4888-ac9b-d59e4662ea13"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:32:31.873523 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-2de5b585-05f6-462a-a8dd-0a44bef9fd1a req-2507ad17-1fb3-4892-b869-2c1b3b076db3 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:31.874383 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-2de5b585-05f6-462a-a8dd-0a44bef9fd1a req-2507ad17-1fb3-4892-b869-2c1b3b076db3 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:31.875652 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-2de5b585-05f6-462a-a8dd-0a44bef9fd1a req-2507ad17-1fb3-4892-b869-2c1b3b076db3 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:31.885205 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-559cf18c-86c4-4459-83c7-dfc155258bd7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:31.891310 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-2de5b585-05f6-462a-a8dd-0a44bef9fd1a req-2507ad17-1fb3-4892-b869-2c1b3b076db3 service nova] Creating event network-vif-plugged:697a5305-479b-4888-ac9b-d59e4662ea13 for instance 22ad3728-5dee-49b1-a62d-3bdfca6b47ce on hv-cinder-80473 Nov 02 07:32:31.895814 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-559cf18c-86c4-4459-83c7-dfc155258bd7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1368 microversion: 2.1 time: 0.315830 Nov 02 07:32:31.897200 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-2de5b585-05f6-462a-a8dd-0a44bef9fd1a req-2507ad17-1fb3-4892-b869-2c1b3b076db3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047571 Nov 02 07:32:31.897986 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 222/455] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:32:31.913827 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 234/456] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:31 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1368 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:32.873906 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ea4db2f3-eb5e-491b-8ce3-a898d97d6d94 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:32.874824 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ea4db2f3-eb5e-491b-8ce3-a898d97d6d94 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:32.881658 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ea4db2f3-eb5e-491b-8ce3-a898d97d6d94 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:32.882146 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ea4db2f3-eb5e-491b-8ce3-a898d97d6d94 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:32.882612 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ea4db2f3-eb5e-491b-8ce3-a898d97d6d94 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:32.883311 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ea4db2f3-eb5e-491b-8ce3-a898d97d6d94 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:32.883791 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ea4db2f3-eb5e-491b-8ce3-a898d97d6d94 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:32.884215 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ea4db2f3-eb5e-491b-8ce3-a898d97d6d94 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:32.920838 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-16b8b578-3d96-47ba-af9a-f428c8c7d777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:32.922541 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-16b8b578-3d96-47ba-af9a-f428c8c7d777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:32.929504 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-16b8b578-3d96-47ba-af9a-f428c8c7d777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:32.930214 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-16b8b578-3d96-47ba-af9a-f428c8c7d777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:32.930824 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-16b8b578-3d96-47ba-af9a-f428c8c7d777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:32.931714 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-16b8b578-3d96-47ba-af9a-f428c8c7d777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:32.932324 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-16b8b578-3d96-47ba-af9a-f428c8c7d777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:32.932915 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-16b8b578-3d96-47ba-af9a-f428c8c7d777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:33.097826 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ea4db2f3-eb5e-491b-8ce3-a898d97d6d94 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:33.116606 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ea4db2f3-eb5e-491b-8ce3-a898d97d6d94 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1259 microversion: 2.1 time: 0.247137 Nov 02 07:32:33.122749 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-16b8b578-3d96-47ba-af9a-f428c8c7d777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:33.131453 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-16b8b578-3d96-47ba-af9a-f428c8c7d777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1368 microversion: 2.1 time: 0.214434 Nov 02 07:32:33.133684 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 223/457] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:32 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1259 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:33.143044 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 235/458] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:32 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:33.927767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-326e79db-f475-48ae-8cd4-cf2461433eb9 req-b6c2eef6-396e-4907-8fec-88348ce2baaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a9cfaf-8301-4add-a31e-805734cc8ad3", "name": "network-vif-plugged", "status": "completed", "tag": "dae949dc-142c-4367-baec-04935624813b"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:32:33.956022 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-326e79db-f475-48ae-8cd4-cf2461433eb9 req-b6c2eef6-396e-4907-8fec-88348ce2baaa service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:33.957987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-326e79db-f475-48ae-8cd4-cf2461433eb9 req-b6c2eef6-396e-4907-8fec-88348ce2baaa service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:33.958547 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-326e79db-f475-48ae-8cd4-cf2461433eb9 req-b6c2eef6-396e-4907-8fec-88348ce2baaa service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:33.972782 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-326e79db-f475-48ae-8cd4-cf2461433eb9 req-b6c2eef6-396e-4907-8fec-88348ce2baaa service nova] Creating event network-vif-plugged:dae949dc-142c-4367-baec-04935624813b for instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 on hv-cinder-80473 Nov 02 07:32:33.979098 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-326e79db-f475-48ae-8cd4-cf2461433eb9 req-b6c2eef6-396e-4907-8fec-88348ce2baaa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055066 Nov 02 07:32:33.980916 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 224/459] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 02 07:32:34.147139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a2d97aff-cf2c-4f97-8fd0-4da06a1aeb1c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:34.147677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a2d97aff-cf2c-4f97-8fd0-4da06a1aeb1c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:34.158752 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2797a196-bacc-4422-b3da-e74d3e097976 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:34.159464 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-2797a196-bacc-4422-b3da-e74d3e097976 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:34.162131 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a2d97aff-cf2c-4f97-8fd0-4da06a1aeb1c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:34.162647 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a2d97aff-cf2c-4f97-8fd0-4da06a1aeb1c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:34.163252 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a2d97aff-cf2c-4f97-8fd0-4da06a1aeb1c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:34.164108 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a2d97aff-cf2c-4f97-8fd0-4da06a1aeb1c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:34.164715 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a2d97aff-cf2c-4f97-8fd0-4da06a1aeb1c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:34.165320 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a2d97aff-cf2c-4f97-8fd0-4da06a1aeb1c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:34.166296 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2797a196-bacc-4422-b3da-e74d3e097976 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:34.167085 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2797a196-bacc-4422-b3da-e74d3e097976 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:34.167677 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2797a196-bacc-4422-b3da-e74d3e097976 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:34.168784 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2797a196-bacc-4422-b3da-e74d3e097976 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:34.169556 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2797a196-bacc-4422-b3da-e74d3e097976 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:34.170270 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2797a196-bacc-4422-b3da-e74d3e097976 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:34.190181 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=100 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:34.383401 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2797a196-bacc-4422-b3da-e74d3e097976 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:34.395117 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a2d97aff-cf2c-4f97-8fd0-4da06a1aeb1c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:34.395788 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-2797a196-bacc-4422-b3da-e74d3e097976 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1368 microversion: 2.1 time: 0.242464 Nov 02 07:32:34.410465 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 225/460] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:34 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:34.410756 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a2d97aff-cf2c-4f97-8fd0-4da06a1aeb1c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1443 microversion: 2.1 time: 0.259830 Nov 02 07:32:34.414711 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 236/461] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:34 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1443 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:34.426900 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c3ec8066-a6fa-456e-9e87-0844e844f708 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:34.427513 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c3ec8066-a6fa-456e-9e87-0844e844f708 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:34.434768 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c3ec8066-a6fa-456e-9e87-0844e844f708 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:34.435262 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c3ec8066-a6fa-456e-9e87-0844e844f708 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:34.435690 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c3ec8066-a6fa-456e-9e87-0844e844f708 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:34.436376 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c3ec8066-a6fa-456e-9e87-0844e844f708 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:34.436821 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c3ec8066-a6fa-456e-9e87-0844e844f708 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:34.437868 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c3ec8066-a6fa-456e-9e87-0844e844f708 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:34.602401 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c3ec8066-a6fa-456e-9e87-0844e844f708 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:34.608764 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c3ec8066-a6fa-456e-9e87-0844e844f708 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1443 microversion: 2.1 time: 0.186126 Nov 02 07:32:34.617504 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 226/462] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:34 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1443 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:32:35.423447 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5d2ae4b4-4e3c-4bca-8ec7-bf8d6cd804f5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:35.424635 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-5d2ae4b4-4e3c-4bca-8ec7-bf8d6cd804f5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:35.434887 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5d2ae4b4-4e3c-4bca-8ec7-bf8d6cd804f5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:35.435395 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5d2ae4b4-4e3c-4bca-8ec7-bf8d6cd804f5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:35.435999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5d2ae4b4-4e3c-4bca-8ec7-bf8d6cd804f5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:35.436713 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5d2ae4b4-4e3c-4bca-8ec7-bf8d6cd804f5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:35.437442 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5d2ae4b4-4e3c-4bca-8ec7-bf8d6cd804f5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:35.438243 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5d2ae4b4-4e3c-4bca-8ec7-bf8d6cd804f5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:35.702539 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-5d2ae4b4-4e3c-4bca-8ec7-bf8d6cd804f5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:35.711229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-5d2ae4b4-4e3c-4bca-8ec7-bf8d6cd804f5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1368 microversion: 2.1 time: 0.292369 Nov 02 07:32:35.712153 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 237/463] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:35 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1368 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:36.708635 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-b85d8e15-8d9c-410d-a5e0-46ec6d18be70 req-4d8fd7ac-5f02-4ff8-840d-8d452fea1fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ad3728-5dee-49b1-a62d-3bdfca6b47ce", "tag": "697a5305-479b-4888-ac9b-d59e4662ea13"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:32:36.719948 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-b85d8e15-8d9c-410d-a5e0-46ec6d18be70 req-4d8fd7ac-5f02-4ff8-840d-8d452fea1fb8 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:36.720797 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-b85d8e15-8d9c-410d-a5e0-46ec6d18be70 req-4d8fd7ac-5f02-4ff8-840d-8d452fea1fb8 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:36.721447 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-b85d8e15-8d9c-410d-a5e0-46ec6d18be70 req-4d8fd7ac-5f02-4ff8-840d-8d452fea1fb8 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:36.735043 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-b85d8e15-8d9c-410d-a5e0-46ec6d18be70 req-4d8fd7ac-5f02-4ff8-840d-8d452fea1fb8 service nova] Creating event network-changed:697a5305-479b-4888-ac9b-d59e4662ea13 for instance 22ad3728-5dee-49b1-a62d-3bdfca6b47ce on hv-cinder-80473 Nov 02 07:32:36.736933 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8ea5d1c9-37de-496c-890b-df7dec676621 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:36.737559 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8ea5d1c9-37de-496c-890b-df7dec676621 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:36.741291 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-b85d8e15-8d9c-410d-a5e0-46ec6d18be70 req-4d8fd7ac-5f02-4ff8-840d-8d452fea1fb8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036371 Nov 02 07:32:36.742506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 227/464] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:32:36.748305 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8ea5d1c9-37de-496c-890b-df7dec676621 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:36.749087 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8ea5d1c9-37de-496c-890b-df7dec676621 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:36.750032 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8ea5d1c9-37de-496c-890b-df7dec676621 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:36.751237 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8ea5d1c9-37de-496c-890b-df7dec676621 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:36.751930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8ea5d1c9-37de-496c-890b-df7dec676621 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:36.752570 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8ea5d1c9-37de-496c-890b-df7dec676621 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:36.899718 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8ea5d1c9-37de-496c-890b-df7dec676621 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:32:36.910146 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8ea5d1c9-37de-496c-890b-df7dec676621 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1558 microversion: 2.1 time: 0.178003 Nov 02 07:32:36.911404 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 238/465] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:32:36 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:32:36.935464 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-49649aa8-a401-4f46-9a9f-8d347ef4cbde tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:32:36.936436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-49649aa8-a401-4f46-9a9f-8d347ef4cbde tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:36.944482 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-49649aa8-a401-4f46-9a9f-8d347ef4cbde tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:36.945327 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-49649aa8-a401-4f46-9a9f-8d347ef4cbde tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:36.945994 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-49649aa8-a401-4f46-9a9f-8d347ef4cbde tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:36.946944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-49649aa8-a401-4f46-9a9f-8d347ef4cbde tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:36.947612 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-49649aa8-a401-4f46-9a9f-8d347ef4cbde tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:36.948246 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-49649aa8-a401-4f46-9a9f-8d347ef4cbde tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:37.044483 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-49649aa8-a401-4f46-9a9f-8d347ef4cbde tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113239 Nov 02 07:32:37.045392 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 228/466] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 07:32:36 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:32:38.961577 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-50661125-d723-41e5-8a8c-a92c4f1c2ef4 req-e5cb5c57-e1c2-4c50-968b-66c9f4b30a29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a9cfaf-8301-4add-a31e-805734cc8ad3", "tag": "dae949dc-142c-4367-baec-04935624813b"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:32:38.982411 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-50661125-d723-41e5-8a8c-a92c4f1c2ef4 req-e5cb5c57-e1c2-4c50-968b-66c9f4b30a29 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:38.983186 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-50661125-d723-41e5-8a8c-a92c4f1c2ef4 req-e5cb5c57-e1c2-4c50-968b-66c9f4b30a29 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:38.983793 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-50661125-d723-41e5-8a8c-a92c4f1c2ef4 req-e5cb5c57-e1c2-4c50-968b-66c9f4b30a29 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:38.996693 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-50661125-d723-41e5-8a8c-a92c4f1c2ef4 req-e5cb5c57-e1c2-4c50-968b-66c9f4b30a29 service nova] Creating event network-changed:dae949dc-142c-4367-baec-04935624813b for instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 on hv-cinder-80473 Nov 02 07:32:39.005852 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-50661125-d723-41e5-8a8c-a92c4f1c2ef4 req-e5cb5c57-e1c2-4c50-968b-66c9f4b30a29 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047788 Nov 02 07:32:39.006389 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 239/467] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:32:52.714802 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:52.715545 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=68 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:52.720830 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-dd7a0fdf-dfbc-4fc0-b88b-d4cc23ef6c89 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a2a9f03-dcb2-4f49-94df-b7166fc1f05e"}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:32:52.723151 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-dd7a0fdf-dfbc-4fc0-b88b-d4cc23ef6c89 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:32:52.731068 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dd7a0fdf-dfbc-4fc0-b88b-d4cc23ef6c89 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:52.731550 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dd7a0fdf-dfbc-4fc0-b88b-d4cc23ef6c89 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:52.731981 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dd7a0fdf-dfbc-4fc0-b88b-d4cc23ef6c89 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:52.732663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dd7a0fdf-dfbc-4fc0-b88b-d4cc23ef6c89 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:32:52.733108 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dd7a0fdf-dfbc-4fc0-b88b-d4cc23ef6c89 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:32:52.733525 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-dd7a0fdf-dfbc-4fc0-b88b-d4cc23ef6c89 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:32:53.392215 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-dd7a0fdf-dfbc-4fc0-b88b-d4cc23ef6c89 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "POST /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.678514 Nov 02 07:32:53.398244 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 229/468] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 07:32:52 2022] POST /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/os-volume_attachments => generated 194 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:33:00.927492 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:00.928237 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=17 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:00.933497 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-6690cae2-fd40-4719-bfc2-131b9c4448e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:00.935908 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-6690cae2-fd40-4719-bfc2-131b9c4448e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:00.944444 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6690cae2-fd40-4719-bfc2-131b9c4448e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:00.944929 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6690cae2-fd40-4719-bfc2-131b9c4448e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:00.945366 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6690cae2-fd40-4719-bfc2-131b9c4448e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:00.946054 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6690cae2-fd40-4719-bfc2-131b9c4448e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:00.946550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6690cae2-fd40-4719-bfc2-131b9c4448e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:00.946979 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6690cae2-fd40-4719-bfc2-131b9c4448e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:00.972358 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.objects.instance [None req-6690cae2-fd40-4719-bfc2-131b9c4448e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lazy-loading 'flavor' on Instance uuid 7f8c1657-4f0c-4856-aa2f-7536a549ad16 {{(pid=118991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:33:01.092524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-6690cae2-fd40-4719-bfc2-131b9c4448e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "POST /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/action" status: 200 len: 32 microversion: 2.1 time: 0.166346 Nov 02 07:33:01.093111 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 240/469] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 07:33:00 2022] POST /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 07:33:01.102947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-889770ca-c808-4cb5-a6a9-0fbe202157c5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:01.103640 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-889770ca-c808-4cb5-a6a9-0fbe202157c5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:01.110753 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-889770ca-c808-4cb5-a6a9-0fbe202157c5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:01.111956 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-889770ca-c808-4cb5-a6a9-0fbe202157c5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:01.112540 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-889770ca-c808-4cb5-a6a9-0fbe202157c5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:01.113240 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-889770ca-c808-4cb5-a6a9-0fbe202157c5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:01.113717 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-889770ca-c808-4cb5-a6a9-0fbe202157c5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:01.114276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-889770ca-c808-4cb5-a6a9-0fbe202157c5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:01.250245 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-889770ca-c808-4cb5-a6a9-0fbe202157c5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:01.259203 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-889770ca-c808-4cb5-a6a9-0fbe202157c5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.160453 Nov 02 07:33:01.259772 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 230/470] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:01 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:02.284130 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-41987c5c-9417-4f08-a8f0-f1e34c35d379 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:02.284822 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-41987c5c-9417-4f08-a8f0-f1e34c35d379 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:02.290952 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-41987c5c-9417-4f08-a8f0-f1e34c35d379 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:02.291421 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-41987c5c-9417-4f08-a8f0-f1e34c35d379 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:02.291844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-41987c5c-9417-4f08-a8f0-f1e34c35d379 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:02.292511 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-41987c5c-9417-4f08-a8f0-f1e34c35d379 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:02.292951 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-41987c5c-9417-4f08-a8f0-f1e34c35d379 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:02.293362 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-41987c5c-9417-4f08-a8f0-f1e34c35d379 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:02.423043 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-41987c5c-9417-4f08-a8f0-f1e34c35d379 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:02.431480 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-41987c5c-9417-4f08-a8f0-f1e34c35d379 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.152482 Nov 02 07:33:02.432042 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 241/471] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:02 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:03.454726 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9dd26517-bd01-4909-80a1-50839474bd39 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:03.455894 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9dd26517-bd01-4909-80a1-50839474bd39 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:03.462302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9dd26517-bd01-4909-80a1-50839474bd39 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:03.462807 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9dd26517-bd01-4909-80a1-50839474bd39 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:03.463236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9dd26517-bd01-4909-80a1-50839474bd39 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:03.463911 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9dd26517-bd01-4909-80a1-50839474bd39 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:03.464355 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9dd26517-bd01-4909-80a1-50839474bd39 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:03.464772 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9dd26517-bd01-4909-80a1-50839474bd39 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:03.597988 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9dd26517-bd01-4909-80a1-50839474bd39 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:03.606099 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9dd26517-bd01-4909-80a1-50839474bd39 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.155258 Nov 02 07:33:03.606686 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 231/472] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:03 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:04.629483 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-3c75666d-4ca9-4dbe-b513-493f37f3fbd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:04.630085 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-3c75666d-4ca9-4dbe-b513-493f37f3fbd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:04.637434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3c75666d-4ca9-4dbe-b513-493f37f3fbd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:04.637910 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3c75666d-4ca9-4dbe-b513-493f37f3fbd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:04.638343 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3c75666d-4ca9-4dbe-b513-493f37f3fbd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:04.639159 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3c75666d-4ca9-4dbe-b513-493f37f3fbd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:04.639601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3c75666d-4ca9-4dbe-b513-493f37f3fbd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:04.640023 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3c75666d-4ca9-4dbe-b513-493f37f3fbd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:04.768502 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-3c75666d-4ca9-4dbe-b513-493f37f3fbd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:04.776652 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-3c75666d-4ca9-4dbe-b513-493f37f3fbd8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.151798 Nov 02 07:33:04.777211 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 242/473] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:04 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:05.800750 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-8e5f4176-e287-402c-bc8a-cad013ccbdbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:05.801358 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-8e5f4176-e287-402c-bc8a-cad013ccbdbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:05.807962 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8e5f4176-e287-402c-bc8a-cad013ccbdbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:05.808442 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8e5f4176-e287-402c-bc8a-cad013ccbdbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:05.808873 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8e5f4176-e287-402c-bc8a-cad013ccbdbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:05.809556 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8e5f4176-e287-402c-bc8a-cad013ccbdbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:05.810011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8e5f4176-e287-402c-bc8a-cad013ccbdbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:05.810464 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8e5f4176-e287-402c-bc8a-cad013ccbdbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:05.936679 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-8e5f4176-e287-402c-bc8a-cad013ccbdbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:05.944874 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-8e5f4176-e287-402c-bc8a-cad013ccbdbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.148568 Nov 02 07:33:05.945427 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 232/474] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:05 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:06.967978 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-176bb656-f292-4fc7-8dd9-967e5e211ee2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:06.968614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-176bb656-f292-4fc7-8dd9-967e5e211ee2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:06.975650 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-176bb656-f292-4fc7-8dd9-967e5e211ee2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:06.976126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-176bb656-f292-4fc7-8dd9-967e5e211ee2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:06.976553 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-176bb656-f292-4fc7-8dd9-967e5e211ee2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:06.977234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-176bb656-f292-4fc7-8dd9-967e5e211ee2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:06.977681 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-176bb656-f292-4fc7-8dd9-967e5e211ee2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:06.978104 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-176bb656-f292-4fc7-8dd9-967e5e211ee2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:07.112961 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-176bb656-f292-4fc7-8dd9-967e5e211ee2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:07.121094 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-176bb656-f292-4fc7-8dd9-967e5e211ee2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.156983 Nov 02 07:33:07.121649 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 243/475] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:06 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:08.145227 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1a481360-4b08-4144-8426-203f1844996c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:08.145840 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1a481360-4b08-4144-8426-203f1844996c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:08.152317 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1a481360-4b08-4144-8426-203f1844996c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:08.152793 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1a481360-4b08-4144-8426-203f1844996c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:08.153222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1a481360-4b08-4144-8426-203f1844996c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:08.153903 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1a481360-4b08-4144-8426-203f1844996c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:08.154353 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1a481360-4b08-4144-8426-203f1844996c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:08.154797 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1a481360-4b08-4144-8426-203f1844996c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:08.284565 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1a481360-4b08-4144-8426-203f1844996c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:08.292902 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-1a481360-4b08-4144-8426-203f1844996c tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.151653 Nov 02 07:33:08.293461 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 233/476] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:08 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:09.317002 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c5457bf4-d9a6-4b4e-88d5-2836b90469a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:09.317605 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c5457bf4-d9a6-4b4e-88d5-2836b90469a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:09.324203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c5457bf4-d9a6-4b4e-88d5-2836b90469a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:09.324681 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c5457bf4-d9a6-4b4e-88d5-2836b90469a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:09.325114 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c5457bf4-d9a6-4b4e-88d5-2836b90469a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:09.325799 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c5457bf4-d9a6-4b4e-88d5-2836b90469a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:09.326277 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c5457bf4-d9a6-4b4e-88d5-2836b90469a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:09.326736 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c5457bf4-d9a6-4b4e-88d5-2836b90469a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:09.458495 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c5457bf4-d9a6-4b4e-88d5-2836b90469a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:09.466655 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c5457bf4-d9a6-4b4e-88d5-2836b90469a8 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.153514 Nov 02 07:33:09.467222 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 244/477] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:09 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:10.434608 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2c1f361d-cf08-4819-8cad-a8a1e0eca397 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:10.435194 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-2c1f361d-cf08-4819-8cad-a8a1e0eca397 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:10.441627 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2c1f361d-cf08-4819-8cad-a8a1e0eca397 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:10.442094 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2c1f361d-cf08-4819-8cad-a8a1e0eca397 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:10.442672 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2c1f361d-cf08-4819-8cad-a8a1e0eca397 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:10.443306 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2c1f361d-cf08-4819-8cad-a8a1e0eca397 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:10.443748 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2c1f361d-cf08-4819-8cad-a8a1e0eca397 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:10.444167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2c1f361d-cf08-4819-8cad-a8a1e0eca397 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:10.475493 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-2c1f361d-cf08-4819-8cad-a8a1e0eca397 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/os-volume_attachments/572d9390-3818-4c95-a441-176885163883" status: 200 len: 194 microversion: 2.20 time: 0.044916 Nov 02 07:33:10.476060 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 234/478] 10.222.0.18 () {60 vars in 1454 bytes} [Wed Nov 2 07:33:10 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/os-volume_attachments/572d9390-3818-4c95-a441-176885163883 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:33:10.491200 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f777c043-51c2-4271-8eff-bb8aa5f3380d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:10.491810 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f777c043-51c2-4271-8eff-bb8aa5f3380d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:10.498034 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f777c043-51c2-4271-8eff-bb8aa5f3380d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:10.498813 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f777c043-51c2-4271-8eff-bb8aa5f3380d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:10.499241 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f777c043-51c2-4271-8eff-bb8aa5f3380d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:10.499915 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f777c043-51c2-4271-8eff-bb8aa5f3380d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:10.500358 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f777c043-51c2-4271-8eff-bb8aa5f3380d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:10.500772 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f777c043-51c2-4271-8eff-bb8aa5f3380d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:10.545507 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-766573fe-fd16-474b-be1c-8e970ff93b09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:10.545993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-766573fe-fd16-474b-be1c-8e970ff93b09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:10.552845 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-766573fe-fd16-474b-be1c-8e970ff93b09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:10.553261 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-766573fe-fd16-474b-be1c-8e970ff93b09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:10.553690 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-766573fe-fd16-474b-be1c-8e970ff93b09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:10.554396 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-766573fe-fd16-474b-be1c-8e970ff93b09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:10.554847 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-766573fe-fd16-474b-be1c-8e970ff93b09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:10.555268 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-766573fe-fd16-474b-be1c-8e970ff93b09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:10.631395 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f777c043-51c2-4271-8eff-bb8aa5f3380d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:10.640980 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f777c043-51c2-4271-8eff-bb8aa5f3380d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.154474 Nov 02 07:33:10.655014 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 245/479] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:10 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:10.685070 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-766573fe-fd16-474b-be1c-8e970ff93b09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lazy-loading 'services' on Instance uuid cae04f42-6d0d-42e5-ae5f-8022b6f546df {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:33:10.796490 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-766573fe-fd16-474b-be1c-8e970ff93b09 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/os-volume_attachments/572d9390-3818-4c95-a441-176885163883" status: 202 len: 0 microversion: 2.20 time: 0.254845 Nov 02 07:33:10.797085 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 235/480] 10.222.0.18 () {60 vars in 1457 bytes} [Wed Nov 2 07:33:10 2022] DELETE /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/os-volume_attachments/572d9390-3818-4c95-a441-176885163883 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 07:33:10.806143 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-4d85df62-cd4b-4189-97bb-516846285427 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:10.808484 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-4d85df62-cd4b-4189-97bb-516846285427 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:10.815441 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d85df62-cd4b-4189-97bb-516846285427 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:10.816108 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d85df62-cd4b-4189-97bb-516846285427 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:10.816543 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d85df62-cd4b-4189-97bb-516846285427 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:10.817265 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d85df62-cd4b-4189-97bb-516846285427 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:10.817714 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d85df62-cd4b-4189-97bb-516846285427 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:10.818134 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d85df62-cd4b-4189-97bb-516846285427 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:10.847753 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-4d85df62-cd4b-4189-97bb-516846285427 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045458 Nov 02 07:33:10.848318 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 246/481] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 07:33:10 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:33:11.666786 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c73aab59-27d4-463a-a502-fc7ba8a891fc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:11.667481 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c73aab59-27d4-463a-a502-fc7ba8a891fc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:11.673811 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c73aab59-27d4-463a-a502-fc7ba8a891fc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:11.674294 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c73aab59-27d4-463a-a502-fc7ba8a891fc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:11.674750 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c73aab59-27d4-463a-a502-fc7ba8a891fc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:11.675440 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c73aab59-27d4-463a-a502-fc7ba8a891fc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:11.675894 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c73aab59-27d4-463a-a502-fc7ba8a891fc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:11.676724 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c73aab59-27d4-463a-a502-fc7ba8a891fc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:11.807958 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c73aab59-27d4-463a-a502-fc7ba8a891fc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:11.816226 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c73aab59-27d4-463a-a502-fc7ba8a891fc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.154131 Nov 02 07:33:11.816720 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 236/482] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:11 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:11.860423 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-07e8a0ba-5924-4863-a849-4c265cfda0bc tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:11.862745 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-07e8a0ba-5924-4863-a849-4c265cfda0bc tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:11.869296 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07e8a0ba-5924-4863-a849-4c265cfda0bc tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:11.869779 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07e8a0ba-5924-4863-a849-4c265cfda0bc tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:11.870220 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07e8a0ba-5924-4863-a849-4c265cfda0bc tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:11.870986 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07e8a0ba-5924-4863-a849-4c265cfda0bc tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:11.871437 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07e8a0ba-5924-4863-a849-4c265cfda0bc tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:11.871860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07e8a0ba-5924-4863-a849-4c265cfda0bc tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:11.902673 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-07e8a0ba-5924-4863-a849-4c265cfda0bc tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046120 Nov 02 07:33:11.903232 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 247/483] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 07:33:11 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:11.967505 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-aa592143-4bea-4f58-a84e-62703a97a4d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:11.967994 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-aa592143-4bea-4f58-a84e-62703a97a4d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:11.974388 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa592143-4bea-4f58-a84e-62703a97a4d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:11.974859 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa592143-4bea-4f58-a84e-62703a97a4d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:11.975284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa592143-4bea-4f58-a84e-62703a97a4d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:11.975950 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa592143-4bea-4f58-a84e-62703a97a4d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:11.976390 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa592143-4bea-4f58-a84e-62703a97a4d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:11.976797 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa592143-4bea-4f58-a84e-62703a97a4d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:12.005210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-aa592143-4bea-4f58-a84e-62703a97a4d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Going to try to terminate instance {{(pid=118992) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:33:12.085476 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-aa592143-4bea-4f58-a84e-62703a97a4d1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 204 len: 0 microversion: 2.20 time: 0.121375 Nov 02 07:33:12.085984 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 237/484] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 07:33:11 2022] DELETE /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 07:33:12.094038 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c90ef71d-aa6f-4b99-ba74-a3cc619436ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:12.094673 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c90ef71d-aa6f-4b99-ba74-a3cc619436ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:12.101094 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c90ef71d-aa6f-4b99-ba74-a3cc619436ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:12.101546 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c90ef71d-aa6f-4b99-ba74-a3cc619436ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:12.101976 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c90ef71d-aa6f-4b99-ba74-a3cc619436ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:12.102679 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c90ef71d-aa6f-4b99-ba74-a3cc619436ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:12.103130 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c90ef71d-aa6f-4b99-ba74-a3cc619436ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:12.103548 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c90ef71d-aa6f-4b99-ba74-a3cc619436ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:12.229559 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c90ef71d-aa6f-4b99-ba74-a3cc619436ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:12.237650 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c90ef71d-aa6f-4b99-ba74-a3cc619436ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:12.239113 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c90ef71d-aa6f-4b99-ba74-a3cc619436ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:12.240286 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c90ef71d-aa6f-4b99-ba74-a3cc619436ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1722 microversion: 2.20 time: 0.150083 Nov 02 07:33:12.240833 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 248/485] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:12 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:33:12.840307 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0f30a216-3aae-4c6c-baf4-c4e6e038d892 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:12.840987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-0f30a216-3aae-4c6c-baf4-c4e6e038d892 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:12.847881 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0f30a216-3aae-4c6c-baf4-c4e6e038d892 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:12.848354 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0f30a216-3aae-4c6c-baf4-c4e6e038d892 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:12.848780 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0f30a216-3aae-4c6c-baf4-c4e6e038d892 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:12.849466 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0f30a216-3aae-4c6c-baf4-c4e6e038d892 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:12.849914 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0f30a216-3aae-4c6c-baf4-c4e6e038d892 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:12.850331 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0f30a216-3aae-4c6c-baf4-c4e6e038d892 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:12.977138 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-0f30a216-3aae-4c6c-baf4-c4e6e038d892 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:12.985361 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-0f30a216-3aae-4c6c-baf4-c4e6e038d892 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.149247 Nov 02 07:33:12.985912 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 238/486] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:12 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:13.266278 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-67e5e037-e81c-49e2-bb0b-2a3cfcb1daca tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:13.266909 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-67e5e037-e81c-49e2-bb0b-2a3cfcb1daca tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:13.273581 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-67e5e037-e81c-49e2-bb0b-2a3cfcb1daca tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:13.274053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-67e5e037-e81c-49e2-bb0b-2a3cfcb1daca tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:13.274538 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-67e5e037-e81c-49e2-bb0b-2a3cfcb1daca tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:13.275377 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-67e5e037-e81c-49e2-bb0b-2a3cfcb1daca tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:13.275928 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-67e5e037-e81c-49e2-bb0b-2a3cfcb1daca tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:13.276438 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-67e5e037-e81c-49e2-bb0b-2a3cfcb1daca tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:13.409721 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-67e5e037-e81c-49e2-bb0b-2a3cfcb1daca tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:13.417755 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-67e5e037-e81c-49e2-bb0b-2a3cfcb1daca tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:13.419209 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-67e5e037-e81c-49e2-bb0b-2a3cfcb1daca tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:13.420365 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-67e5e037-e81c-49e2-bb0b-2a3cfcb1daca tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1722 microversion: 2.20 time: 0.157968 Nov 02 07:33:13.420911 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 249/487] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:13 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:33:14.008843 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-56d0a0ba-bee5-4bcd-b688-dcc7cc8f027a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:14.009447 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-56d0a0ba-bee5-4bcd-b688-dcc7cc8f027a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:14.015946 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-56d0a0ba-bee5-4bcd-b688-dcc7cc8f027a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:14.016441 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-56d0a0ba-bee5-4bcd-b688-dcc7cc8f027a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:14.016852 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-56d0a0ba-bee5-4bcd-b688-dcc7cc8f027a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:14.017533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-56d0a0ba-bee5-4bcd-b688-dcc7cc8f027a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:14.018605 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-56d0a0ba-bee5-4bcd-b688-dcc7cc8f027a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:14.019056 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-56d0a0ba-bee5-4bcd-b688-dcc7cc8f027a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:14.146867 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-56d0a0ba-bee5-4bcd-b688-dcc7cc8f027a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:14.154993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-56d0a0ba-bee5-4bcd-b688-dcc7cc8f027a tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.150082 Nov 02 07:33:14.155562 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 239/488] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:14 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:14.446926 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-7cb66ea4-2c35-4ede-8888-443876b213f0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:14.447538 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-7cb66ea4-2c35-4ede-8888-443876b213f0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:14.454267 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7cb66ea4-2c35-4ede-8888-443876b213f0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:14.454799 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7cb66ea4-2c35-4ede-8888-443876b213f0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:14.455235 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7cb66ea4-2c35-4ede-8888-443876b213f0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:14.456571 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7cb66ea4-2c35-4ede-8888-443876b213f0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:14.457019 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7cb66ea4-2c35-4ede-8888-443876b213f0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:14.457440 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7cb66ea4-2c35-4ede-8888-443876b213f0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:14.860191 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7cb66ea4-2c35-4ede-8888-443876b213f0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:14.869010 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7cb66ea4-2c35-4ede-8888-443876b213f0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:14.870459 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7cb66ea4-2c35-4ede-8888-443876b213f0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:14.871609 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-7cb66ea4-2c35-4ede-8888-443876b213f0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1722 microversion: 2.20 time: 0.428668 Nov 02 07:33:14.872361 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 250/489] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:14 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1722 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:33:15.138747 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-c6d70616-e79f-4453-ace3-7b187afb2fb0 req-af521e6c-6ee2-4994-84c8-15ef9a1af874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae04f42-6d0d-42e5-ae5f-8022b6f546df", "name": "network-vif-deleted", "tag": "ba58ff3d-570b-447a-86ec-a6d9a70152fc"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:15.149782 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c6d70616-e79f-4453-ace3-7b187afb2fb0 req-af521e6c-6ee2-4994-84c8-15ef9a1af874 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:15.150375 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c6d70616-e79f-4453-ace3-7b187afb2fb0 req-af521e6c-6ee2-4994-84c8-15ef9a1af874 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:15.150880 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c6d70616-e79f-4453-ace3-7b187afb2fb0 req-af521e6c-6ee2-4994-84c8-15ef9a1af874 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:15.166839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-c6d70616-e79f-4453-ace3-7b187afb2fb0 req-af521e6c-6ee2-4994-84c8-15ef9a1af874 service nova] Creating event network-vif-deleted:ba58ff3d-570b-447a-86ec-a6d9a70152fc for instance cae04f42-6d0d-42e5-ae5f-8022b6f546df on hv-cinder-80473 Nov 02 07:33:15.175031 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-c6d70616-e79f-4453-ace3-7b187afb2fb0 req-af521e6c-6ee2-4994-84c8-15ef9a1af874 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041333 Nov 02 07:33:15.176501 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 240/490] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:33:15.180940 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-663821fe-1d1a-44f0-adc7-f45dfe2b417d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:15.181587 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-663821fe-1d1a-44f0-adc7-f45dfe2b417d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:15.188104 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-663821fe-1d1a-44f0-adc7-f45dfe2b417d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:15.188574 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-663821fe-1d1a-44f0-adc7-f45dfe2b417d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:15.189006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-663821fe-1d1a-44f0-adc7-f45dfe2b417d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:15.189879 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-663821fe-1d1a-44f0-adc7-f45dfe2b417d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:15.190445 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-663821fe-1d1a-44f0-adc7-f45dfe2b417d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:15.190777 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-663821fe-1d1a-44f0-adc7-f45dfe2b417d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:15.340552 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-663821fe-1d1a-44f0-adc7-f45dfe2b417d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:15.352998 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-663821fe-1d1a-44f0-adc7-f45dfe2b417d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.175037 Nov 02 07:33:15.354186 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 251/491] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:15 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:33:15.898144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d4866451-ecae-4f9a-b11c-95569b60e568 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:15.899123 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-d4866451-ecae-4f9a-b11c-95569b60e568 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:15.905482 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d4866451-ecae-4f9a-b11c-95569b60e568 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:15.906066 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d4866451-ecae-4f9a-b11c-95569b60e568 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:15.906644 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d4866451-ecae-4f9a-b11c-95569b60e568 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:15.907429 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d4866451-ecae-4f9a-b11c-95569b60e568 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:15.908182 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d4866451-ecae-4f9a-b11c-95569b60e568 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:15.909365 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d4866451-ecae-4f9a-b11c-95569b60e568 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:15.952412 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d4866451-ecae-4f9a-b11c-95569b60e568 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:15.952934 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d4866451-ecae-4f9a-b11c-95569b60e568 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:15.953368 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d4866451-ecae-4f9a-b11c-95569b60e568 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:15.954005 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-d4866451-ecae-4f9a-b11c-95569b60e568 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lazy-loading 'fault' on Instance uuid cae04f42-6d0d-42e5-ae5f-8022b6f546df {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:33:16.010210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-d4866451-ecae-4f9a-b11c-95569b60e568 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:16.022721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-d4866451-ecae-4f9a-b11c-95569b60e568 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:16.024267 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-d4866451-ecae-4f9a-b11c-95569b60e568 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:16.025541 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-d4866451-ecae-4f9a-b11c-95569b60e568 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 200 len: 1371 microversion: 2.20 time: 0.131935 Nov 02 07:33:16.026103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 241/492] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:15 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 1371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:33:16.380041 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-653cedf8-0584-4593-b591-c93fd3adb11d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:16.381576 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-653cedf8-0584-4593-b591-c93fd3adb11d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:16.391817 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-653cedf8-0584-4593-b591-c93fd3adb11d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:16.392577 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-653cedf8-0584-4593-b591-c93fd3adb11d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:16.393325 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-653cedf8-0584-4593-b591-c93fd3adb11d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:16.394692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-653cedf8-0584-4593-b591-c93fd3adb11d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:16.395037 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-653cedf8-0584-4593-b591-c93fd3adb11d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:16.395462 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-653cedf8-0584-4593-b591-c93fd3adb11d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:16.539012 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-653cedf8-0584-4593-b591-c93fd3adb11d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:16.547741 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-653cedf8-0584-4593-b591-c93fd3adb11d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.174269 Nov 02 07:33:16.548577 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 252/493] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:16 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:17.051052 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7515920e-f549-4ca8-87b5-f42c79868146 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:17.051703 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-7515920e-f549-4ca8-87b5-f42c79868146 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:17.058533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7515920e-f549-4ca8-87b5-f42c79868146 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:17.059298 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7515920e-f549-4ca8-87b5-f42c79868146 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:17.059487 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7515920e-f549-4ca8-87b5-f42c79868146 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:17.060102 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7515920e-f549-4ca8-87b5-f42c79868146 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:17.060546 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7515920e-f549-4ca8-87b5-f42c79868146 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:17.060964 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7515920e-f549-4ca8-87b5-f42c79868146 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:17.065169 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:17.076505 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-7515920e-f549-4ca8-87b5-f42c79868146 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] HTTP exception thrown: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7515920e-f549-4ca8-87b5-f42c79868146 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Request method failure captured: Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df HTTP/1.1 Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhxWuTpbS47usYs0qSbI_CRGJyPC087ezEilEmqpOstTAdji_P96WqXa2OhChVtSUZjArS0_us3sPUI1q2-yh7TL-8laTUy7TdNOH6oFa4XCrYLW3j3fgyjT5p1YtRc6sQVovx1mu8rs5ZdpKMLDJhVNB_4eKtrpMY872kal00p-mso Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: df168e1504c947169b74f50c1ed4de95 Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:33:17.078209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:33:17.079808 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_df168e1504c947169b74f50c1ed4de95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:33:17.079808 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:33:17.079808 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: df168e1504c947169b74f50c1ed4de95 Nov 02 07:33:17.079808 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:33:17.079808 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-AttachVolumeShelveTestJSON-163710944-project Nov 02 07:33:17.079808 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:33:17.079808 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:33:17.079808 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 2455ebfc92ba4d398a6279d6102a0408 Nov 02 07:33:17.079808 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-AttachVolumeShelveTestJSON-163710944-project Nov 02 07:33:17.079808 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:33:17.079808 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. Nov 02 07:33:17.079808 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': 'cae04f42-6d0d-42e5-ae5f-8022b6f546df'} Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:33:17.081265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. Nov 02 07:33:17.082891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:33:17.084152 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7515920e-f549-4ca8-87b5-f42c79868146 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Returning 404 to user: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:33:17.084152 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-7515920e-f549-4ca8-87b5-f42c79868146 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 404 len: 111 microversion: 2.20 time: 0.032640 Nov 02 07:33:17.084152 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 242/494] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:17 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 07:33:17.089471 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b3aaca56-6641-4b2e-b1ff-91469dbdc11b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '.version_select at 0x7f4d6a3a83a0>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:17.118165 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b3aaca56-6641-4b2e-b1ff-91469dbdc11b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107069774" status: 204 len: 0 microversion: 2.20 time: 0.032417 Nov 02 07:33:17.118840 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 253/495] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Nov 2 07:33:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107069774 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 07:33:17.571742 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-aebae95a-a07c-47ad-a088-fe191d1fd01d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:17.572343 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-aebae95a-a07c-47ad-a088-fe191d1fd01d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:17.579181 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aebae95a-a07c-47ad-a088-fe191d1fd01d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:17.579793 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aebae95a-a07c-47ad-a088-fe191d1fd01d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:17.580435 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aebae95a-a07c-47ad-a088-fe191d1fd01d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:17.581849 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aebae95a-a07c-47ad-a088-fe191d1fd01d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:17.582297 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aebae95a-a07c-47ad-a088-fe191d1fd01d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:17.582746 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aebae95a-a07c-47ad-a088-fe191d1fd01d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:17.729782 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-aebae95a-a07c-47ad-a088-fe191d1fd01d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:17.737401 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-aebae95a-a07c-47ad-a088-fe191d1fd01d tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.169745 Nov 02 07:33:17.738402 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 243/496] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:17 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:33:17.747346 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-e9ec0bdb-e883-43e1-919d-d7cf419b4b2a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Action: 'create', calling method: .version_select at 0x7f4d6a3a0940>, body: {"keypair": {"name": "tempest-keypair-1441580938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6AWikh5RKo/FH6ML4+6Bmr500crsV/ndtYFrytz9goWT48Tq5YRbBQoArXEZjGgzao/ZBJLrON6UAzIU+oXQRoLKguJ1MLWkvki5oE2ZBoFHY5o50T1usc0Js4LXl+PQ=="}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:17.763611 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-e9ec0bdb-e883-43e1-919d-d7cf419b4b2a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Getting quotas for project df168e1504c947169b74f50c1ed4de95. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:33:17.767362 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-e9ec0bdb-e883-43e1-919d-d7cf419b4b2a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Getting quotas for user 2455ebfc92ba4d398a6279d6102a0408 and project df168e1504c947169b74f50c1ed4de95. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:33:17.789615 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e9ec0bdb-e883-43e1-919d-d7cf419b4b2a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046586 Nov 02 07:33:17.790200 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 254/497] 10.222.0.18 () {62 vars in 1200 bytes} [Wed Nov 2 07:33:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Nov 02 07:33:18.761063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6f37aa45-490b-48ab-a3ea-1d9a11e834d1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:18.761783 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-6f37aa45-490b-48ab-a3ea-1d9a11e834d1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:18.769079 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6f37aa45-490b-48ab-a3ea-1d9a11e834d1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:18.769568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6f37aa45-490b-48ab-a3ea-1d9a11e834d1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:18.770004 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6f37aa45-490b-48ab-a3ea-1d9a11e834d1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:18.770741 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6f37aa45-490b-48ab-a3ea-1d9a11e834d1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:18.771192 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6f37aa45-490b-48ab-a3ea-1d9a11e834d1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:18.771617 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6f37aa45-490b-48ab-a3ea-1d9a11e834d1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:18.968793 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-6f37aa45-490b-48ab-a3ea-1d9a11e834d1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:18.977066 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-6f37aa45-490b-48ab-a3ea-1d9a11e834d1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.220029 Nov 02 07:33:18.977624 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 244/498] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:18 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:19.161398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-272576960", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc944948-bf48-4be4-9702-2103a8c937e6"}], "security_groups": [{"name": "tempest-securitygroup--826852804"}], "key_name": "tempest-keypair-1441580938", "user_data": "}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:19.265034 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.network.neutron [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] validate_networks() for [('dc944948-bf48-4be4-9702-2103a8c937e6', None, None, None, None, None)] {{(pid=118991) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:33:19.629270 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Flavor limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:33:19.629694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Image limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:33:19.630172 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Flavor pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:33:19.630618 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Image pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:33:19.631047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:33:19.639769 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:19.640261 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:19.640695 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:19.641428 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:19.641880 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:19.642305 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:19.659453 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Getting quotas for project df168e1504c947169b74f50c1ed4de95. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:33:19.663435 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Getting quotas for user 2455ebfc92ba4d398a6279d6102a0408 and project df168e1504c947169b74f50c1ed4de95. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:33:19.675120 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Going to run 1 instances... {{(pid=118991) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:33:19.677581 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:33:19.724732 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-5b060354-3c90-4756-9c3e-ddcbfcc9bcb2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.567961 Nov 02 07:33:19.725374 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 255/499] 10.222.0.18 () {62 vars in 1188 bytes} [Wed Nov 2 07:33:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 07:33:19.737461 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-df776f5c-7e30-463b-95c5-36f6ff2d8be5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:19.738321 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-df776f5c-7e30-463b-95c5-36f6ff2d8be5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:19.792928 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-df776f5c-7e30-463b-95c5-36f6ff2d8be5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:19.800452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-df776f5c-7e30-463b-95c5-36f6ff2d8be5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:19.801980 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-df776f5c-7e30-463b-95c5-36f6ff2d8be5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:19.803105 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-df776f5c-7e30-463b-95c5-36f6ff2d8be5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1281 microversion: 2.20 time: 0.070534 Nov 02 07:33:19.803667 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 245/500] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:19 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:33:20.001661 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2efe7716-5d2a-44f9-8878-f1d0dea2327b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:20.002320 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2efe7716-5d2a-44f9-8878-f1d0dea2327b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:20.009334 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2efe7716-5d2a-44f9-8878-f1d0dea2327b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:20.009823 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2efe7716-5d2a-44f9-8878-f1d0dea2327b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:20.010327 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2efe7716-5d2a-44f9-8878-f1d0dea2327b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:20.011043 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2efe7716-5d2a-44f9-8878-f1d0dea2327b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:20.011492 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2efe7716-5d2a-44f9-8878-f1d0dea2327b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:20.012630 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2efe7716-5d2a-44f9-8878-f1d0dea2327b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:20.150784 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2efe7716-5d2a-44f9-8878-f1d0dea2327b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:20.159746 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2efe7716-5d2a-44f9-8878-f1d0dea2327b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1735 microversion: 2.1 time: 0.162637 Nov 02 07:33:20.160321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 256/501] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:19 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:20.827990 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c054c0ba-d18b-4931-b174-e1c7e1d4fe50 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:20.828595 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c054c0ba-d18b-4931-b174-e1c7e1d4fe50 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:20.836078 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c054c0ba-d18b-4931-b174-e1c7e1d4fe50 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:20.836560 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c054c0ba-d18b-4931-b174-e1c7e1d4fe50 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:20.836990 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c054c0ba-d18b-4931-b174-e1c7e1d4fe50 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:20.837679 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c054c0ba-d18b-4931-b174-e1c7e1d4fe50 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:20.838130 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c054c0ba-d18b-4931-b174-e1c7e1d4fe50 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:20.838582 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c054c0ba-d18b-4931-b174-e1c7e1d4fe50 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:20.901816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c054c0ba-d18b-4931-b174-e1c7e1d4fe50 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:20.911799 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c054c0ba-d18b-4931-b174-e1c7e1d4fe50 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:20.913240 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c054c0ba-d18b-4931-b174-e1c7e1d4fe50 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:20.914332 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c054c0ba-d18b-4931-b174-e1c7e1d4fe50 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1333 microversion: 2.20 time: 0.090222 Nov 02 07:33:20.914917 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 246/502] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:20 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:33:21.184770 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-4770b2df-c262-4b2c-ac20-dce8b68868bb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:21.185723 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-4770b2df-c262-4b2c-ac20-dce8b68868bb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:21.192478 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4770b2df-c262-4b2c-ac20-dce8b68868bb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:21.193090 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4770b2df-c262-4b2c-ac20-dce8b68868bb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:21.193589 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4770b2df-c262-4b2c-ac20-dce8b68868bb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:21.194533 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4770b2df-c262-4b2c-ac20-dce8b68868bb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:21.194996 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4770b2df-c262-4b2c-ac20-dce8b68868bb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:21.195607 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4770b2df-c262-4b2c-ac20-dce8b68868bb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:21.200710 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:21.336567 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-4770b2df-c262-4b2c-ac20-dce8b68868bb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:21.344962 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-4770b2df-c262-4b2c-ac20-dce8b68868bb tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1715 microversion: 2.1 time: 0.164539 Nov 02 07:33:21.345498 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 257/503] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:21 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1715 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:21.463566 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c71cbf58-00ca-428c-b0fb-015d18438ab1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:21.464059 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c71cbf58-00ca-428c-b0fb-015d18438ab1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:21.469884 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c71cbf58-00ca-428c-b0fb-015d18438ab1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:21.470388 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c71cbf58-00ca-428c-b0fb-015d18438ab1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:21.470819 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c71cbf58-00ca-428c-b0fb-015d18438ab1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:21.472113 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c71cbf58-00ca-428c-b0fb-015d18438ab1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:21.472571 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c71cbf58-00ca-428c-b0fb-015d18438ab1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:21.472991 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c71cbf58-00ca-428c-b0fb-015d18438ab1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:21.557233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-c71cbf58-00ca-428c-b0fb-015d18438ab1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] HTTP exception thrown: Cannot 'detach_volume' instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 while it is in vm_state rescued Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c71cbf58-00ca-428c-b0fb-015d18438ab1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Request method failure captured: Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: DELETE /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/os-volume_attachments/4a2a9f03-dcb2-4f49-94df-b7166fc1f05e HTTP/1.1 Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhxUEtNtZTs4ic7TO1YHq64wZsN5qBfs97ESDbbUSAfzzoKKF4aWoMtTWeaBh0tZLpMPcjYYxG24mgb4lumO_vWqHxQoVjCNp3JVn1PYMG7yUkIv-CwxwRq4pRuWrgDLhanWDwQK429gy3U8ZyWDQ8-vGuKkNzeaxCqAyS8AZk8aIVo Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: c60cb95cbf734d9b852af2bdcad4e1c0 Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-276708690 Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:33:21.558785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:33:21.560302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c60cb95cbf734d9b852af2bdcad4e1c0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c60cb95cbf734d9b852af2bdcad4e1c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c60cb95cbf734d9b852af2bdcad4e1c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c60cb95cbf734d9b852af2bdcad4e1c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:33:21.560302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-ServerRescueNegativeTestJSON-276708690 Nov 02 07:33:21.560302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: c60cb95cbf734d9b852af2bdcad4e1c0 Nov 02 07:33:21.560302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-276708690 Nov 02 07:33:21.560302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-ServerRescueNegativeTestJSON-276708690-project Nov 02 07:33:21.560302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:33:21.560302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:33:21.560302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 0e571b0f4d6f4fafb71939f501b8deec Nov 02 07:33:21.560302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-ServerRescueNegativeTestJSON-276708690-project Nov 02 07:33:21.560302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:33:21.560302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Cannot 'detach_volume' instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 while it is in vm_state rescued Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'server_id': '7f8c1657-4f0c-4856-aa2f-7536a549ad16', 'id': '4a2a9f03-dcb2-4f49-94df-b7166fc1f05e'} Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 in vm_state rescued. Cannot detach_volume while the instance is in this state. Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:33:21.561225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:33:21.562767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Nov 02 07:33:21.562767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 07:33:21.562767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 07:33:21.562767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 07:33:21.562767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 while it is in vm_state rescued Nov 02 07:33:21.562767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:33:21.562767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:33:21.562767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:33:21.562767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:21.562767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:33:21.562767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:33:21.562767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:33:21.562767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:33:21.562767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 while it is in vm_state rescued Nov 02 07:33:21.562767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:33:21.562767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c71cbf58-00ca-428c-b0fb-015d18438ab1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Returning 409 to user: Cannot 'detach_volume' instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 while it is in vm_state rescued {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:33:21.564132 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c71cbf58-00ca-428c-b0fb-015d18438ab1 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/os-volume_attachments/4a2a9f03-dcb2-4f49-94df-b7166fc1f05e" status: 409 len: 152 microversion: 2.1 time: 0.100566 Nov 02 07:33:21.564132 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 247/504] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 07:33:21 2022] DELETE /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/os-volume_attachments/4a2a9f03-dcb2-4f49-94df-b7166fc1f05e => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 07:33:21.568982 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a8d0f60f-6ba6-4c81-9606-bf9240fb5024 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:21.569509 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a8d0f60f-6ba6-4c81-9606-bf9240fb5024 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:21.575337 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8d0f60f-6ba6-4c81-9606-bf9240fb5024 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:21.575818 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8d0f60f-6ba6-4c81-9606-bf9240fb5024 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:21.576247 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8d0f60f-6ba6-4c81-9606-bf9240fb5024 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:21.576930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8d0f60f-6ba6-4c81-9606-bf9240fb5024 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:21.577376 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8d0f60f-6ba6-4c81-9606-bf9240fb5024 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:21.577793 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8d0f60f-6ba6-4c81-9606-bf9240fb5024 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:21.648866 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a8d0f60f-6ba6-4c81-9606-bf9240fb5024 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "POST /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/action" status: 202 len: 0 microversion: 2.1 time: 0.082666 Nov 02 07:33:21.652861 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 258/505] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 07:33:21 2022] POST /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:33:21.660575 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a6843313-5374-4c84-bbfa-668790312726 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:21.661449 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a6843313-5374-4c84-bbfa-668790312726 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:21.669340 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a6843313-5374-4c84-bbfa-668790312726 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:21.670007 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a6843313-5374-4c84-bbfa-668790312726 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:21.670471 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a6843313-5374-4c84-bbfa-668790312726 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:21.671175 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a6843313-5374-4c84-bbfa-668790312726 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:21.671632 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a6843313-5374-4c84-bbfa-668790312726 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:21.672057 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a6843313-5374-4c84-bbfa-668790312726 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:21.902397 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a6843313-5374-4c84-bbfa-668790312726 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:21.912778 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a6843313-5374-4c84-bbfa-668790312726 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1723 microversion: 2.1 time: 0.257468 Nov 02 07:33:21.921673 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 248/506] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:21 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:33:21.941440 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-13b5f141-aea0-4d90-8a14-8ef29560c6bf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:21.942163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-13b5f141-aea0-4d90-8a14-8ef29560c6bf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:21.949985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13b5f141-aea0-4d90-8a14-8ef29560c6bf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:21.950771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13b5f141-aea0-4d90-8a14-8ef29560c6bf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:21.951720 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13b5f141-aea0-4d90-8a14-8ef29560c6bf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:21.952639 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13b5f141-aea0-4d90-8a14-8ef29560c6bf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:21.953328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13b5f141-aea0-4d90-8a14-8ef29560c6bf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:21.953957 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-13b5f141-aea0-4d90-8a14-8ef29560c6bf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:22.194265 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-13b5f141-aea0-4d90-8a14-8ef29560c6bf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:22.204196 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-13b5f141-aea0-4d90-8a14-8ef29560c6bf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:22.206701 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-13b5f141-aea0-4d90-8a14-8ef29560c6bf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:22.208271 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-13b5f141-aea0-4d90-8a14-8ef29560c6bf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1406 microversion: 2.20 time: 0.272209 Nov 02 07:33:22.210163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 259/507] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:21 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:33:22.656248 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-aee959b7-8812-469d-84a0-06a2ec78fc6d req-df642f8d-14f7-42ac-b272-fea449407302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e24f861-ba20-4595-9dd5-9ea1f9832284", "tag": "9b205abf-2fab-4e5a-9b1e-0110c74b9f93"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:22.666873 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-aee959b7-8812-469d-84a0-06a2ec78fc6d req-df642f8d-14f7-42ac-b272-fea449407302 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:22.667368 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-aee959b7-8812-469d-84a0-06a2ec78fc6d req-df642f8d-14f7-42ac-b272-fea449407302 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:22.667796 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-aee959b7-8812-469d-84a0-06a2ec78fc6d req-df642f8d-14f7-42ac-b272-fea449407302 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:22.680581 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-aee959b7-8812-469d-84a0-06a2ec78fc6d req-df642f8d-14f7-42ac-b272-fea449407302 service nova] Creating event network-changed:9b205abf-2fab-4e5a-9b1e-0110c74b9f93 for instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 on hv-cinder-80473 Nov 02 07:33:22.685900 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-aee959b7-8812-469d-84a0-06a2ec78fc6d req-df642f8d-14f7-42ac-b272-fea449407302 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033275 Nov 02 07:33:22.687163 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 249/508] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:33:22.944969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-da968fd9-c052-443a-b4f1-6c13593f56da tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:22.945520 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-da968fd9-c052-443a-b4f1-6c13593f56da tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:22.951508 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da968fd9-c052-443a-b4f1-6c13593f56da tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:22.951981 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da968fd9-c052-443a-b4f1-6c13593f56da tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:22.952402 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da968fd9-c052-443a-b4f1-6c13593f56da tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:22.953075 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da968fd9-c052-443a-b4f1-6c13593f56da tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:22.953514 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da968fd9-c052-443a-b4f1-6c13593f56da tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:22.953930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da968fd9-c052-443a-b4f1-6c13593f56da tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:23.081284 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-da968fd9-c052-443a-b4f1-6c13593f56da tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:23.089432 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-da968fd9-c052-443a-b4f1-6c13593f56da tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1723 microversion: 2.1 time: 0.148353 Nov 02 07:33:23.090000 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 260/509] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:22 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:23.234827 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1b68f37e-8aff-41e3-ab87-4e52870ca82f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:23.235447 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1b68f37e-8aff-41e3-ab87-4e52870ca82f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:23.237460 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:23.242980 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b68f37e-8aff-41e3-ab87-4e52870ca82f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:23.243459 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b68f37e-8aff-41e3-ab87-4e52870ca82f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:23.243914 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b68f37e-8aff-41e3-ab87-4e52870ca82f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:23.244612 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b68f37e-8aff-41e3-ab87-4e52870ca82f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:23.245063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b68f37e-8aff-41e3-ab87-4e52870ca82f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:23.245485 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1b68f37e-8aff-41e3-ab87-4e52870ca82f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:23.377180 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1b68f37e-8aff-41e3-ab87-4e52870ca82f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:23.385776 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1b68f37e-8aff-41e3-ab87-4e52870ca82f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:23.387249 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1b68f37e-8aff-41e3-ab87-4e52870ca82f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:23.388349 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-1b68f37e-8aff-41e3-ab87-4e52870ca82f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1406 microversion: 2.20 time: 0.158427 Nov 02 07:33:23.388914 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 250/510] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:23 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:33:24.113994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-91bb74ca-68a8-42a9-a1df-a4f2a0c1fd0f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:24.114745 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-91bb74ca-68a8-42a9-a1df-a4f2a0c1fd0f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:24.121198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91bb74ca-68a8-42a9-a1df-a4f2a0c1fd0f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:24.121683 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91bb74ca-68a8-42a9-a1df-a4f2a0c1fd0f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:24.122144 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91bb74ca-68a8-42a9-a1df-a4f2a0c1fd0f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:24.122871 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91bb74ca-68a8-42a9-a1df-a4f2a0c1fd0f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:24.123329 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91bb74ca-68a8-42a9-a1df-a4f2a0c1fd0f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:24.124015 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91bb74ca-68a8-42a9-a1df-a4f2a0c1fd0f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:24.257084 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-91bb74ca-68a8-42a9-a1df-a4f2a0c1fd0f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:24.265907 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-91bb74ca-68a8-42a9-a1df-a4f2a0c1fd0f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1723 microversion: 2.1 time: 0.156348 Nov 02 07:33:24.266548 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 261/511] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:24 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:24.413588 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9165a6fc-5557-46db-ab2f-ba26faecb52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:24.414185 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9165a6fc-5557-46db-ab2f-ba26faecb52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:24.420672 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9165a6fc-5557-46db-ab2f-ba26faecb52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:24.421149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9165a6fc-5557-46db-ab2f-ba26faecb52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:24.421572 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9165a6fc-5557-46db-ab2f-ba26faecb52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:24.422254 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9165a6fc-5557-46db-ab2f-ba26faecb52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:24.422732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9165a6fc-5557-46db-ab2f-ba26faecb52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:24.423151 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9165a6fc-5557-46db-ab2f-ba26faecb52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:24.552014 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9165a6fc-5557-46db-ab2f-ba26faecb52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:24.559988 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9165a6fc-5557-46db-ab2f-ba26faecb52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:24.561431 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9165a6fc-5557-46db-ab2f-ba26faecb52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:24.562554 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9165a6fc-5557-46db-ab2f-ba26faecb52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1406 microversion: 2.20 time: 0.152861 Nov 02 07:33:24.563106 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 251/512] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:24 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:33:25.289786 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-cab53e38-db6d-4f39-ae03-7e7310e13e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:25.291018 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-cab53e38-db6d-4f39-ae03-7e7310e13e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:25.297481 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cab53e38-db6d-4f39-ae03-7e7310e13e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:25.298174 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cab53e38-db6d-4f39-ae03-7e7310e13e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:25.299139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cab53e38-db6d-4f39-ae03-7e7310e13e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:25.299879 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cab53e38-db6d-4f39-ae03-7e7310e13e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:25.300333 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cab53e38-db6d-4f39-ae03-7e7310e13e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:25.300753 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cab53e38-db6d-4f39-ae03-7e7310e13e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:25.436558 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-cab53e38-db6d-4f39-ae03-7e7310e13e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:25.445941 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-cab53e38-db6d-4f39-ae03-7e7310e13e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1729 microversion: 2.1 time: 0.159752 Nov 02 07:33:25.446706 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 262/513] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:25 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:25.469467 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a119c706-02a6-43c3-85fa-34c363440c51 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:25.470002 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a119c706-02a6-43c3-85fa-34c363440c51 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:25.476437 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a119c706-02a6-43c3-85fa-34c363440c51 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:25.476912 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a119c706-02a6-43c3-85fa-34c363440c51 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:25.477336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a119c706-02a6-43c3-85fa-34c363440c51 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:25.478009 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a119c706-02a6-43c3-85fa-34c363440c51 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:25.478484 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a119c706-02a6-43c3-85fa-34c363440c51 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:25.478903 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a119c706-02a6-43c3-85fa-34c363440c51 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:25.556366 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a119c706-02a6-43c3-85fa-34c363440c51 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090629 Nov 02 07:33:25.556946 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 252/514] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 07:33:25 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:33:25.587765 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-7c1146e6-b950-45e0-9972-24fe30261625 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:25.588379 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-7c1146e6-b950-45e0-9972-24fe30261625 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:25.594767 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7c1146e6-b950-45e0-9972-24fe30261625 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:25.595249 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7c1146e6-b950-45e0-9972-24fe30261625 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:25.595684 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7c1146e6-b950-45e0-9972-24fe30261625 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:25.596415 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7c1146e6-b950-45e0-9972-24fe30261625 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:25.596873 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7c1146e6-b950-45e0-9972-24fe30261625 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:25.597302 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7c1146e6-b950-45e0-9972-24fe30261625 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:25.719048 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-18c6b4d5-a451-4562-a98c-c3b9957c9285 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:25.719468 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-18c6b4d5-a451-4562-a98c-c3b9957c9285 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:25.726033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-18c6b4d5-a451-4562-a98c-c3b9957c9285 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:25.726556 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-18c6b4d5-a451-4562-a98c-c3b9957c9285 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:25.726996 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-18c6b4d5-a451-4562-a98c-c3b9957c9285 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:25.727694 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-18c6b4d5-a451-4562-a98c-c3b9957c9285 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:25.728148 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-18c6b4d5-a451-4562-a98c-c3b9957c9285 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:25.728575 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-18c6b4d5-a451-4562-a98c-c3b9957c9285 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:25.753168 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-18c6b4d5-a451-4562-a98c-c3b9957c9285 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3/ips" status: 200 len: 149 microversion: 2.1 time: 0.037684 Nov 02 07:33:25.753879 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 253/515] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 07:33:25 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:33:25.765184 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-cbabb6ef-7ae8-4f1b-96ed-72825f530f07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bad46e0b-e50f-43d1-890a-15bb3d66550f"}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:25.767631 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-cbabb6ef-7ae8-4f1b-96ed-72825f530f07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:25.774167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cbabb6ef-7ae8-4f1b-96ed-72825f530f07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:25.774692 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cbabb6ef-7ae8-4f1b-96ed-72825f530f07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:25.775128 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cbabb6ef-7ae8-4f1b-96ed-72825f530f07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:25.775824 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cbabb6ef-7ae8-4f1b-96ed-72825f530f07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:25.776280 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cbabb6ef-7ae8-4f1b-96ed-72825f530f07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:25.776707 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cbabb6ef-7ae8-4f1b-96ed-72825f530f07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:25.858293 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7c1146e6-b950-45e0-9972-24fe30261625 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:25.858486 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-cbabb6ef-7ae8-4f1b-96ed-72825f530f07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] HTTP exception thrown: Invalid volume: volume bad46e0b-e50f-43d1-890a-15bb3d66550f is already attached to instances: 793f8cfa-443a-4695-861e-6ba4c4e441ab Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-cbabb6ef-7ae8-4f1b-96ed-72825f530f07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Request method failure captured: Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: POST /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3/os-volume_attachments HTTP/1.1 Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 74 Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhytX4Fqrx49tZr8XMSeqOuiVVe5QhR5pSkx822MlHR1MwQprRFdpyDwzWSFm2fCfS3S5s_QIudHlvHUSGGla4ObJvPgMlXRPp30GlwXPuRdB_YwvXPaPkzMw2fsaqcBcgnloHZe9knHcPTV7sOfEXdhYljLTd7gzyDjmltPZHCDm9w Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:33:25.860284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:33:25.861524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba3bab98d31d49098a8e7242d51be646", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:33:25.861524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:33:25.861524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:33:25.861524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:33:25.861524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:33:25.861524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:33:25.861524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:33:25.861524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 47965dc7f5964bbfa4efff0822530965 Nov 02 07:33:25.861524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:33:25.861524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Nov 02 07:33:25.861524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {"volumeAttachment": {"volumeId": "bad46e0b-e50f-43d1-890a-15bb3d66550f"}} Nov 02 07:33:25.861524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Invalid volume: volume bad46e0b-e50f-43d1-890a-15bb3d66550f is already attached to instances: 793f8cfa-443a-4695-861e-6ba4c4e441ab Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'server_id': 'b9a9cfaf-8301-4add-a31e-805734cc8ad3', 'body': {'volumeAttachment': {'volumeId': 'bad46e0b-e50f-43d1-890a-15bb3d66550f'}}} Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bad46e0b-e50f-43d1-890a-15bb3d66550f is already attached to instances: 793f8cfa-443a-4695-861e-6ba4c4e441ab Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:33:25.862282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bad46e0b-e50f-43d1-890a-15bb3d66550f is already attached to instances: 793f8cfa-443a-4695-861e-6ba4c4e441ab Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:25.863436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:33:25.864534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:33:25.864534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:33:25.864534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:33:25.864534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bad46e0b-e50f-43d1-890a-15bb3d66550f is already attached to instances: 793f8cfa-443a-4695-861e-6ba4c4e441ab Nov 02 07:33:25.864534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:33:25.864534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-cbabb6ef-7ae8-4f1b-96ed-72825f530f07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Returning 400 to user: Invalid volume: volume bad46e0b-e50f-43d1-890a-15bb3d66550f is already attached to instances: 793f8cfa-443a-4695-861e-6ba4c4e441ab {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:33:25.864534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-cbabb6ef-7ae8-4f1b-96ed-72825f530f07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "POST /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100545 Nov 02 07:33:25.864534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 254/516] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 07:33:25 2022] POST /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 07:33:25.867135 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7c1146e6-b950-45e0-9972-24fe30261625 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:25.868953 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7c1146e6-b950-45e0-9972-24fe30261625 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:25.870257 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-7c1146e6-b950-45e0-9972-24fe30261625 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1406 microversion: 2.20 time: 0.286415 Nov 02 07:33:25.870943 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-934876aa-8710-479f-8bb0-0bb76637082c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:25.871439 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-934876aa-8710-479f-8bb0-0bb76637082c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:25.876777 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 263/517] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:25 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:33:25.877992 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-934876aa-8710-479f-8bb0-0bb76637082c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:25.878507 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-934876aa-8710-479f-8bb0-0bb76637082c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:25.878937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-934876aa-8710-479f-8bb0-0bb76637082c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:25.879802 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-934876aa-8710-479f-8bb0-0bb76637082c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:25.880260 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-934876aa-8710-479f-8bb0-0bb76637082c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:25.880684 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-934876aa-8710-479f-8bb0-0bb76637082c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:25.906710 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-934876aa-8710-479f-8bb0-0bb76637082c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Going to try to terminate instance {{(pid=118992) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:33:25.981563 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-934876aa-8710-479f-8bb0-0bb76637082c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 204 len: 0 microversion: 2.1 time: 0.114109 Nov 02 07:33:25.982398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 255/518] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:33:25 2022] DELETE /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:33:25.991051 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d92afd26-1bd2-4915-a3a1-1e3277f0f8db tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:25.991756 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-d92afd26-1bd2-4915-a3a1-1e3277f0f8db tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:25.997699 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d92afd26-1bd2-4915-a3a1-1e3277f0f8db tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:25.998176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d92afd26-1bd2-4915-a3a1-1e3277f0f8db tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:25.998643 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d92afd26-1bd2-4915-a3a1-1e3277f0f8db tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:25.999590 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d92afd26-1bd2-4915-a3a1-1e3277f0f8db tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:26.000034 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d92afd26-1bd2-4915-a3a1-1e3277f0f8db tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:26.000453 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d92afd26-1bd2-4915-a3a1-1e3277f0f8db tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:26.230239 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d92afd26-1bd2-4915-a3a1-1e3277f0f8db tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:26.239728 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d92afd26-1bd2-4915-a3a1-1e3277f0f8db tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1682 microversion: 2.1 time: 0.253158 Nov 02 07:33:26.240324 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 264/519] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:25 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1682 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:26.858814 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-ff68195f-7d5c-4f33-b51f-1114b37bdd9d req-3c92ab80-7c71-43dd-90c2-aaa95dd34939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f8c1657-4f0c-4856-aa2f-7536a549ad16", "tag": "47c195f9-fe3d-4872-a0a9-ef4120548d09"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:26.869375 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-ff68195f-7d5c-4f33-b51f-1114b37bdd9d req-3c92ab80-7c71-43dd-90c2-aaa95dd34939 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:26.869853 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-ff68195f-7d5c-4f33-b51f-1114b37bdd9d req-3c92ab80-7c71-43dd-90c2-aaa95dd34939 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:26.870591 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-ff68195f-7d5c-4f33-b51f-1114b37bdd9d req-3c92ab80-7c71-43dd-90c2-aaa95dd34939 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:26.884867 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-ff68195f-7d5c-4f33-b51f-1114b37bdd9d req-3c92ab80-7c71-43dd-90c2-aaa95dd34939 service nova] Creating event network-changed:47c195f9-fe3d-4872-a0a9-ef4120548d09 for instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 on hv-cinder-80473 Nov 02 07:33:26.891537 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-ff68195f-7d5c-4f33-b51f-1114b37bdd9d req-3c92ab80-7c71-43dd-90c2-aaa95dd34939 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036718 Nov 02 07:33:26.892135 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 256/520] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:33:26.895847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b89b4bb8-7cfa-47c9-9cad-eac7a6819d6b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:26.896449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b89b4bb8-7cfa-47c9-9cad-eac7a6819d6b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:26.903271 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b89b4bb8-7cfa-47c9-9cad-eac7a6819d6b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:26.903747 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b89b4bb8-7cfa-47c9-9cad-eac7a6819d6b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:26.904170 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b89b4bb8-7cfa-47c9-9cad-eac7a6819d6b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:26.904848 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b89b4bb8-7cfa-47c9-9cad-eac7a6819d6b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:26.905291 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b89b4bb8-7cfa-47c9-9cad-eac7a6819d6b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:26.905707 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b89b4bb8-7cfa-47c9-9cad-eac7a6819d6b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:27.035822 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b89b4bb8-7cfa-47c9-9cad-eac7a6819d6b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:27.043818 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b89b4bb8-7cfa-47c9-9cad-eac7a6819d6b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:27.045225 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b89b4bb8-7cfa-47c9-9cad-eac7a6819d6b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:27.046316 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b89b4bb8-7cfa-47c9-9cad-eac7a6819d6b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1406 microversion: 2.20 time: 0.154925 Nov 02 07:33:27.046888 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 265/521] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:26 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:33:27.264957 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-48d814e2-058c-4aec-aedb-b1ad62ba3637 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:27.265645 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-48d814e2-058c-4aec-aedb-b1ad62ba3637 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:27.272662 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-48d814e2-058c-4aec-aedb-b1ad62ba3637 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:27.273142 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-48d814e2-058c-4aec-aedb-b1ad62ba3637 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:27.273569 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-48d814e2-058c-4aec-aedb-b1ad62ba3637 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:27.274258 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-48d814e2-058c-4aec-aedb-b1ad62ba3637 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:27.274919 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-48d814e2-058c-4aec-aedb-b1ad62ba3637 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:27.275346 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-48d814e2-058c-4aec-aedb-b1ad62ba3637 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:27.411204 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-48d814e2-058c-4aec-aedb-b1ad62ba3637 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:27.419018 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-48d814e2-058c-4aec-aedb-b1ad62ba3637 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1682 microversion: 2.1 time: 0.158282 Nov 02 07:33:27.419695 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 257/522] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:27 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:28.071214 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-96c44434-a573-4484-9a3d-efcbcd580f9a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:28.072557 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-96c44434-a573-4484-9a3d-efcbcd580f9a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:28.079966 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-96c44434-a573-4484-9a3d-efcbcd580f9a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:28.081287 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-96c44434-a573-4484-9a3d-efcbcd580f9a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:28.082001 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-96c44434-a573-4484-9a3d-efcbcd580f9a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:28.082937 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-96c44434-a573-4484-9a3d-efcbcd580f9a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:28.083582 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-96c44434-a573-4484-9a3d-efcbcd580f9a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:28.084163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-96c44434-a573-4484-9a3d-efcbcd580f9a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:28.263553 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-96c44434-a573-4484-9a3d-efcbcd580f9a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:28.273358 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-96c44434-a573-4484-9a3d-efcbcd580f9a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:28.274985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-96c44434-a573-4484-9a3d-efcbcd580f9a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:28.276352 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-96c44434-a573-4484-9a3d-efcbcd580f9a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1406 microversion: 2.20 time: 0.208933 Nov 02 07:33:28.276974 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 266/523] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:28 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:33:28.444592 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3c48363f-84c4-43da-a124-cdec77c9fce7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:28.446823 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3c48363f-84c4-43da-a124-cdec77c9fce7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:28.454130 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3c48363f-84c4-43da-a124-cdec77c9fce7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:28.454898 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3c48363f-84c4-43da-a124-cdec77c9fce7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:28.456397 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3c48363f-84c4-43da-a124-cdec77c9fce7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:28.458154 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3c48363f-84c4-43da-a124-cdec77c9fce7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:28.458804 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3c48363f-84c4-43da-a124-cdec77c9fce7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:28.459378 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3c48363f-84c4-43da-a124-cdec77c9fce7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:28.694349 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3c48363f-84c4-43da-a124-cdec77c9fce7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:28.715302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3c48363f-84c4-43da-a124-cdec77c9fce7 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1682 microversion: 2.1 time: 0.276687 Nov 02 07:33:28.716688 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 258/524] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:28 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1682 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:28.907740 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-7224d325-7d71-4005-99be-de1d420d9fe1 req-ea9d45c4-be40-472b-a392-b4ebaa653e84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f8c1657-4f0c-4856-aa2f-7536a549ad16", "tag": "47c195f9-fe3d-4872-a0a9-ef4120548d09"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:28.938946 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-7224d325-7d71-4005-99be-de1d420d9fe1 req-ea9d45c4-be40-472b-a392-b4ebaa653e84 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:28.939664 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-7224d325-7d71-4005-99be-de1d420d9fe1 req-ea9d45c4-be40-472b-a392-b4ebaa653e84 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:28.940881 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-7224d325-7d71-4005-99be-de1d420d9fe1 req-ea9d45c4-be40-472b-a392-b4ebaa653e84 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:28.954771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-7224d325-7d71-4005-99be-de1d420d9fe1 req-ea9d45c4-be40-472b-a392-b4ebaa653e84 service nova] Creating event network-changed:47c195f9-fe3d-4872-a0a9-ef4120548d09 for instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 on hv-cinder-80473 Nov 02 07:33:28.959834 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-7224d325-7d71-4005-99be-de1d420d9fe1 req-ea9d45c4-be40-472b-a392-b4ebaa653e84 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056487 Nov 02 07:33:28.961104 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 267/525] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:33:28.968651 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-91ea80b9-d370-4e22-b775-e5911214aff1 req-4f7edafa-924c-40a7-bd04-757000476c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a9cfaf-8301-4add-a31e-805734cc8ad3", "name": "network-vif-deleted", "tag": "dae949dc-142c-4367-baec-04935624813b"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:28.977904 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-91ea80b9-d370-4e22-b775-e5911214aff1 req-4f7edafa-924c-40a7-bd04-757000476c9b service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:28.978507 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-91ea80b9-d370-4e22-b775-e5911214aff1 req-4f7edafa-924c-40a7-bd04-757000476c9b service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:28.979009 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-91ea80b9-d370-4e22-b775-e5911214aff1 req-4f7edafa-924c-40a7-bd04-757000476c9b service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:28.990351 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-91ea80b9-d370-4e22-b775-e5911214aff1 req-4f7edafa-924c-40a7-bd04-757000476c9b service nova] Creating event network-vif-deleted:dae949dc-142c-4367-baec-04935624813b for instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 on hv-cinder-80473 Nov 02 07:33:28.995180 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-91ea80b9-d370-4e22-b775-e5911214aff1 req-4f7edafa-924c-40a7-bd04-757000476c9b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030146 Nov 02 07:33:28.996071 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 259/526] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:33:29.302261 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0a97713f-7243-41c8-bbbe-6afc777913d6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:29.302985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-0a97713f-7243-41c8-bbbe-6afc777913d6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:29.310347 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0a97713f-7243-41c8-bbbe-6afc777913d6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:29.310851 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0a97713f-7243-41c8-bbbe-6afc777913d6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:29.311275 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0a97713f-7243-41c8-bbbe-6afc777913d6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:29.311959 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0a97713f-7243-41c8-bbbe-6afc777913d6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:29.312407 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0a97713f-7243-41c8-bbbe-6afc777913d6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:29.312820 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0a97713f-7243-41c8-bbbe-6afc777913d6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:29.511327 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0a97713f-7243-41c8-bbbe-6afc777913d6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:29.522912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0a97713f-7243-41c8-bbbe-6afc777913d6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:29.524701 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0a97713f-7243-41c8-bbbe-6afc777913d6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:29.526071 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0a97713f-7243-41c8-bbbe-6afc777913d6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1406 microversion: 2.20 time: 0.228574 Nov 02 07:33:29.527290 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 268/527] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:29 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:33:29.741651 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-34c6f2db-25d2-43af-affe-6a15852edd2f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:29.743117 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-34c6f2db-25d2-43af-affe-6a15852edd2f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:29.750470 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-34c6f2db-25d2-43af-affe-6a15852edd2f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:29.750957 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-34c6f2db-25d2-43af-affe-6a15852edd2f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:29.751552 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-34c6f2db-25d2-43af-affe-6a15852edd2f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:29.752256 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-34c6f2db-25d2-43af-affe-6a15852edd2f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:29.753053 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-34c6f2db-25d2-43af-affe-6a15852edd2f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:29.753634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-34c6f2db-25d2-43af-affe-6a15852edd2f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:29.790423 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-34c6f2db-25d2-43af-affe-6a15852edd2f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:29.790908 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-34c6f2db-25d2-43af-affe-6a15852edd2f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:29.791334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-34c6f2db-25d2-43af-affe-6a15852edd2f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:29.791782 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-34c6f2db-25d2-43af-affe-6a15852edd2f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lazy-loading 'fault' on Instance uuid b9a9cfaf-8301-4add-a31e-805734cc8ad3 {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:33:29.796724 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:29.835419 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-34c6f2db-25d2-43af-affe-6a15852edd2f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:29.844264 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-34c6f2db-25d2-43af-affe-6a15852edd2f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 200 len: 1332 microversion: 2.1 time: 0.107373 Nov 02 07:33:29.844856 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 260/528] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:29 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:29.908646 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-73f5dd2b-913e-460c-8126-33cfadf62b70 req-49c13c93-c8ed-4f6d-85a4-a4be1e911a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e24f861-ba20-4595-9dd5-9ea1f9832284", "name": "network-vif-plugged", "status": "completed", "tag": "9b205abf-2fab-4e5a-9b1e-0110c74b9f93"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:29.914753 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:29.915433 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=10 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:29.921906 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-73f5dd2b-913e-460c-8126-33cfadf62b70 req-49c13c93-c8ed-4f6d-85a4-a4be1e911a17 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:29.922623 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-73f5dd2b-913e-460c-8126-33cfadf62b70 req-49c13c93-c8ed-4f6d-85a4-a4be1e911a17 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:29.923058 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-73f5dd2b-913e-460c-8126-33cfadf62b70 req-49c13c93-c8ed-4f6d-85a4-a4be1e911a17 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:29.935140 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-73f5dd2b-913e-460c-8126-33cfadf62b70 req-49c13c93-c8ed-4f6d-85a4-a4be1e911a17 service nova] Creating event network-vif-plugged:9b205abf-2fab-4e5a-9b1e-0110c74b9f93 for instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 on hv-cinder-80473 Nov 02 07:33:29.940499 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-73f5dd2b-913e-460c-8126-33cfadf62b70 req-49c13c93-c8ed-4f6d-85a4-a4be1e911a17 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034896 Nov 02 07:33:29.941102 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 269/529] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:33:30.551933 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a883dbc5-3566-4ee7-bca2-9b29cac36f16 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:30.552464 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a883dbc5-3566-4ee7-bca2-9b29cac36f16 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:30.558392 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a883dbc5-3566-4ee7-bca2-9b29cac36f16 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:30.558884 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a883dbc5-3566-4ee7-bca2-9b29cac36f16 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:30.559316 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a883dbc5-3566-4ee7-bca2-9b29cac36f16 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:30.559998 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a883dbc5-3566-4ee7-bca2-9b29cac36f16 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:30.560448 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a883dbc5-3566-4ee7-bca2-9b29cac36f16 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:30.560866 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a883dbc5-3566-4ee7-bca2-9b29cac36f16 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:30.564836 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:30.699241 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a883dbc5-3566-4ee7-bca2-9b29cac36f16 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:30.708637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a883dbc5-3566-4ee7-bca2-9b29cac36f16 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:30.710058 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a883dbc5-3566-4ee7-bca2-9b29cac36f16 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:30.711245 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a883dbc5-3566-4ee7-bca2-9b29cac36f16 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1406 microversion: 2.20 time: 0.163306 Nov 02 07:33:30.711794 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 261/530] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:30 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:33:30.869912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-cd453eb3-3ed4-427d-859d-d94f18b221a4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:30.870614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-cd453eb3-3ed4-427d-859d-d94f18b221a4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:30.876986 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd453eb3-3ed4-427d-859d-d94f18b221a4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:30.878298 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd453eb3-3ed4-427d-859d-d94f18b221a4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:30.878767 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd453eb3-3ed4-427d-859d-d94f18b221a4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:30.879454 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd453eb3-3ed4-427d-859d-d94f18b221a4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:30.879906 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd453eb3-3ed4-427d-859d-d94f18b221a4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:30.880329 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd453eb3-3ed4-427d-859d-d94f18b221a4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:30.894050 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-cd453eb3-3ed4-427d-859d-d94f18b221a4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] HTTP exception thrown: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-cd453eb3-3ed4-427d-859d-d94f18b221a4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Request method failure captured: Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 HTTP/1.1 Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhytX4Fqrx49tZr8XMSeqOuiVVe5QhR5pSkx822MlHR1MwQprRFdpyDwzWSFm2fCfS3S5s_QIudHlvHUSGGla4ObJvPgMlXRPp30GlwXPuRdB_YwvXPaPkzMw2fsaqcBcgnloHZe9knHcPTV7sOfEXdhYljLTd7gzyDjmltPZHCDm9w Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:33:30.895674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:33:30.897125 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba3bab98d31d49098a8e7242d51be646", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:33:30.897125 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:33:30.897125 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:33:30.897125 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:33:30.897125 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:33:30.897125 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:33:30.897125 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:33:30.897125 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 47965dc7f5964bbfa4efff0822530965 Nov 02 07:33:30.897125 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:33:30.897125 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:33:30.897125 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. Nov 02 07:33:30.897125 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': 'b9a9cfaf-8301-4add-a31e-805734cc8ad3'} Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:33:30.897969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. Nov 02 07:33:30.899401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:33:30.900753 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-cd453eb3-3ed4-427d-859d-d94f18b221a4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Returning 404 to user: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:33:30.900753 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-cd453eb3-3ed4-427d-859d-d94f18b221a4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 404 len: 111 microversion: 2.1 time: 0.031900 Nov 02 07:33:30.900753 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 270/531] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:30 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:33:30.905754 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3612439b-fed7-4469-ac92-5898d3fe99cd tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '.version_select at 0x7f4d6a304ca0>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:30.925476 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3612439b-fed7-4469-ac92-5898d3fe99cd tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1965427824" status: 202 len: 0 microversion: 2.1 time: 0.023398 Nov 02 07:33:30.926026 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 262/532] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Nov 2 07:33:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1965427824 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:33:31.567000 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-e2d3dbe2-b436-465a-8221-fbc446e04b51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:31.567499 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-e2d3dbe2-b436-465a-8221-fbc446e04b51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:31.569451 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:31.574705 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e2d3dbe2-b436-465a-8221-fbc446e04b51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:31.575179 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e2d3dbe2-b436-465a-8221-fbc446e04b51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:31.575603 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e2d3dbe2-b436-465a-8221-fbc446e04b51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:31.576278 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e2d3dbe2-b436-465a-8221-fbc446e04b51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:31.576725 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e2d3dbe2-b436-465a-8221-fbc446e04b51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:31.577135 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e2d3dbe2-b436-465a-8221-fbc446e04b51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:31.702461 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.objects.instance [None req-e2d3dbe2-b436-465a-8221-fbc446e04b51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lazy-loading 'services' on Instance uuid 793f8cfa-443a-4695-861e-6ba4c4e441ab {{(pid=118991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:33:31.736325 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-39d9fe24-58c6-4cc0-8b73-d9c105139369 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:31.737706 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-39d9fe24-58c6-4cc0-8b73-d9c105139369 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:31.745039 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-39d9fe24-58c6-4cc0-8b73-d9c105139369 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:31.745598 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-39d9fe24-58c6-4cc0-8b73-d9c105139369 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:31.746099 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-39d9fe24-58c6-4cc0-8b73-d9c105139369 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:31.746921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-39d9fe24-58c6-4cc0-8b73-d9c105139369 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:31.747445 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-39d9fe24-58c6-4cc0-8b73-d9c105139369 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:31.747942 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-39d9fe24-58c6-4cc0-8b73-d9c105139369 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:31.821754 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e2d3dbe2-b436-465a-8221-fbc446e04b51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab/os-volume_attachments/bad46e0b-e50f-43d1-890a-15bb3d66550f" status: 202 len: 0 microversion: 2.1 time: 0.258476 Nov 02 07:33:31.822348 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 271/533] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 07:33:31 2022] DELETE /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab/os-volume_attachments/bad46e0b-e50f-43d1-890a-15bb3d66550f => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:33:31.832035 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-e4fae6e6-1d3b-4ef1-a04b-06b323e72c51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:31.834384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-e4fae6e6-1d3b-4ef1-a04b-06b323e72c51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:31.841114 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e4fae6e6-1d3b-4ef1-a04b-06b323e72c51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:31.841600 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e4fae6e6-1d3b-4ef1-a04b-06b323e72c51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:31.842026 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e4fae6e6-1d3b-4ef1-a04b-06b323e72c51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:31.842746 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e4fae6e6-1d3b-4ef1-a04b-06b323e72c51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:31.843198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e4fae6e6-1d3b-4ef1-a04b-06b323e72c51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:31.843671 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e4fae6e6-1d3b-4ef1-a04b-06b323e72c51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:31.878450 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e4fae6e6-1d3b-4ef1-a04b-06b323e72c51 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050542 Nov 02 07:33:31.884033 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 272/534] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 07:33:31 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:33:31.895370 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-39d9fe24-58c6-4cc0-8b73-d9c105139369 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:31.906460 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-39d9fe24-58c6-4cc0-8b73-d9c105139369 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:31.908223 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-39d9fe24-58c6-4cc0-8b73-d9c105139369 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:31.909819 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-39d9fe24-58c6-4cc0-8b73-d9c105139369 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1406 microversion: 2.20 time: 0.177316 Nov 02 07:33:31.910587 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 263/535] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:31 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:33:32.890714 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-e1d99015-7f3c-49a3-a1b4-fc1e994e5332 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:32.892793 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-e1d99015-7f3c-49a3-a1b4-fc1e994e5332 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:32.900149 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e1d99015-7f3c-49a3-a1b4-fc1e994e5332 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:32.900621 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e1d99015-7f3c-49a3-a1b4-fc1e994e5332 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:32.901048 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e1d99015-7f3c-49a3-a1b4-fc1e994e5332 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:32.901720 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e1d99015-7f3c-49a3-a1b4-fc1e994e5332 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:32.902167 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e1d99015-7f3c-49a3-a1b4-fc1e994e5332 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:32.902609 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e1d99015-7f3c-49a3-a1b4-fc1e994e5332 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:32.930695 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e1d99015-7f3c-49a3-a1b4-fc1e994e5332 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044019 Nov 02 07:33:32.931242 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 273/536] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 07:33:32 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 07:33:32.934411 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-b7e4043c-cfe2-45dc-8a99-c42f5352aa7d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:32.935063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-b7e4043c-cfe2-45dc-8a99-c42f5352aa7d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:32.943651 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b7e4043c-cfe2-45dc-8a99-c42f5352aa7d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:32.944170 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b7e4043c-cfe2-45dc-8a99-c42f5352aa7d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:32.944607 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b7e4043c-cfe2-45dc-8a99-c42f5352aa7d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:32.945368 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b7e4043c-cfe2-45dc-8a99-c42f5352aa7d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:32.945827 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b7e4043c-cfe2-45dc-8a99-c42f5352aa7d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:32.946257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b7e4043c-cfe2-45dc-8a99-c42f5352aa7d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:32.995754 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-79da5009-0f9d-4f20-bf60-bc0a375a204c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:32.996242 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-79da5009-0f9d-4f20-bf60-bc0a375a204c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:33.002269 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-79da5009-0f9d-4f20-bf60-bc0a375a204c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:33.003299 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-79da5009-0f9d-4f20-bf60-bc0a375a204c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:33.003726 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-79da5009-0f9d-4f20-bf60-bc0a375a204c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:33.004401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-79da5009-0f9d-4f20-bf60-bc0a375a204c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:33.004842 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-79da5009-0f9d-4f20-bf60-bc0a375a204c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:33.005255 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-79da5009-0f9d-4f20-bf60-bc0a375a204c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:33.010009 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:33.032526 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-79da5009-0f9d-4f20-bf60-bc0a375a204c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Going to try to terminate instance {{(pid=118991) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:33:33.076982 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-b7e4043c-cfe2-45dc-8a99-c42f5352aa7d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:33.085490 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-b7e4043c-cfe2-45dc-8a99-c42f5352aa7d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:33.087108 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-b7e4043c-cfe2-45dc-8a99-c42f5352aa7d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:33.088418 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-b7e4043c-cfe2-45dc-8a99-c42f5352aa7d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1596 microversion: 2.20 time: 0.157654 Nov 02 07:33:33.088963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 264/537] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:33:32 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1596 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:33:33.110497 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-79da5009-0f9d-4f20-bf60-bc0a375a204c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 204 len: 0 microversion: 2.1 time: 0.118112 Nov 02 07:33:33.111193 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 274/538] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:33:32 2022] DELETE /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 07:33:33.115170 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-92a1c5b0-81a0-46b9-88e5-d099e084506a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:33.115718 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-92a1c5b0-81a0-46b9-88e5-d099e084506a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:33.121935 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-92a1c5b0-81a0-46b9-88e5-d099e084506a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:33.122445 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-92a1c5b0-81a0-46b9-88e5-d099e084506a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:33.122573 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b7d16617-5d4a-4efd-ad3f-df0152a97d86 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:33.122882 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-92a1c5b0-81a0-46b9-88e5-d099e084506a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:33.123446 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b7d16617-5d4a-4efd-ad3f-df0152a97d86 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:33.123579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-92a1c5b0-81a0-46b9-88e5-d099e084506a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:33.124033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-92a1c5b0-81a0-46b9-88e5-d099e084506a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:33.124722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-92a1c5b0-81a0-46b9-88e5-d099e084506a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:33.130143 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b7d16617-5d4a-4efd-ad3f-df0152a97d86 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:33.130823 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b7d16617-5d4a-4efd-ad3f-df0152a97d86 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:33.131368 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b7d16617-5d4a-4efd-ad3f-df0152a97d86 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:33.132165 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b7d16617-5d4a-4efd-ad3f-df0152a97d86 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:33.132707 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b7d16617-5d4a-4efd-ad3f-df0152a97d86 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:33.133226 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b7d16617-5d4a-4efd-ad3f-df0152a97d86 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:33.233520 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-92a1c5b0-81a0-46b9-88e5-d099e084506a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.123654 Nov 02 07:33:33.234213 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 265/539] 10.222.0.18 () {60 vars in 1316 bytes} [Wed Nov 2 07:33:33 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:33:33.295486 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b7d16617-5d4a-4efd-ad3f-df0152a97d86 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:33.303302 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b7d16617-5d4a-4efd-ad3f-df0152a97d86 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1680 microversion: 2.1 time: 0.186632 Nov 02 07:33:33.303868 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 275/540] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:33 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:34.327419 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-804a5f7f-870a-46ad-92b4-11df886437e9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:34.328029 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-804a5f7f-870a-46ad-92b4-11df886437e9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:34.334705 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-804a5f7f-870a-46ad-92b4-11df886437e9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:34.335193 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-804a5f7f-870a-46ad-92b4-11df886437e9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:34.335630 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-804a5f7f-870a-46ad-92b4-11df886437e9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:34.336580 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-804a5f7f-870a-46ad-92b4-11df886437e9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:34.337035 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-804a5f7f-870a-46ad-92b4-11df886437e9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:34.337635 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-804a5f7f-870a-46ad-92b4-11df886437e9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:34.348903 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-29af9327-bc02-4bdd-8d8e-b76c77243670 req-678bbf8c-0fa6-4549-a653-0003dd0564fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e24f861-ba20-4595-9dd5-9ea1f9832284", "tag": "9b205abf-2fab-4e5a-9b1e-0110c74b9f93"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:34.358925 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-29af9327-bc02-4bdd-8d8e-b76c77243670 req-678bbf8c-0fa6-4549-a653-0003dd0564fa service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:34.359516 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-29af9327-bc02-4bdd-8d8e-b76c77243670 req-678bbf8c-0fa6-4549-a653-0003dd0564fa service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:34.360055 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-29af9327-bc02-4bdd-8d8e-b76c77243670 req-678bbf8c-0fa6-4549-a653-0003dd0564fa service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:34.371757 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-29af9327-bc02-4bdd-8d8e-b76c77243670 req-678bbf8c-0fa6-4549-a653-0003dd0564fa service nova] Creating event network-changed:9b205abf-2fab-4e5a-9b1e-0110c74b9f93 for instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 on hv-cinder-80473 Nov 02 07:33:34.377254 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-29af9327-bc02-4bdd-8d8e-b76c77243670 req-678bbf8c-0fa6-4549-a653-0003dd0564fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032217 Nov 02 07:33:34.378546 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 276/541] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:33:34.469212 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-804a5f7f-870a-46ad-92b4-11df886437e9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:34.478140 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-804a5f7f-870a-46ad-92b4-11df886437e9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1680 microversion: 2.1 time: 0.154640 Nov 02 07:33:34.478830 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 266/542] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:34 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:35.504604 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-3f556f1c-2a65-455b-9aee-ee7557249c88 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:35.505315 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-3f556f1c-2a65-455b-9aee-ee7557249c88 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:35.511725 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3f556f1c-2a65-455b-9aee-ee7557249c88 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:35.512209 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3f556f1c-2a65-455b-9aee-ee7557249c88 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:35.512648 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3f556f1c-2a65-455b-9aee-ee7557249c88 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:35.513336 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3f556f1c-2a65-455b-9aee-ee7557249c88 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:35.513789 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3f556f1c-2a65-455b-9aee-ee7557249c88 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:35.514211 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3f556f1c-2a65-455b-9aee-ee7557249c88 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:35.609928 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-3f556f1c-2a65-455b-9aee-ee7557249c88 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:35.617867 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-3f556f1c-2a65-455b-9aee-ee7557249c88 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 200 len: 1612 microversion: 2.1 time: 0.119055 Nov 02 07:33:35.618623 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 277/543] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:35 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 1612 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:35.830038 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-c1c585d6-888b-4589-be03-f4f99596f930 req-e7995751-a2c5-4ff9-9f4e-5cd23b3e3b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "793f8cfa-443a-4695-861e-6ba4c4e441ab", "name": "network-vif-deleted", "tag": "01838f4f-9c12-4515-a5e5-af4ef1d4e33e"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:35.841378 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c1c585d6-888b-4589-be03-f4f99596f930 req-e7995751-a2c5-4ff9-9f4e-5cd23b3e3b17 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:35.841854 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c1c585d6-888b-4589-be03-f4f99596f930 req-e7995751-a2c5-4ff9-9f4e-5cd23b3e3b17 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:35.842280 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c1c585d6-888b-4589-be03-f4f99596f930 req-e7995751-a2c5-4ff9-9f4e-5cd23b3e3b17 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:35.854567 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-c1c585d6-888b-4589-be03-f4f99596f930 req-e7995751-a2c5-4ff9-9f4e-5cd23b3e3b17 service nova] Creating event network-vif-deleted:01838f4f-9c12-4515-a5e5-af4ef1d4e33e for instance 793f8cfa-443a-4695-861e-6ba4c4e441ab on hv-cinder-80473 Nov 02 07:33:35.859571 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-c1c585d6-888b-4589-be03-f4f99596f930 req-e7995751-a2c5-4ff9-9f4e-5cd23b3e3b17 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033150 Nov 02 07:33:35.860401 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 267/544] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:33:36.641785 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0298a32a-c730-48c4-a6f6-813c803d484d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:36.643616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-0298a32a-c730-48c4-a6f6-813c803d484d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:36.654802 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0298a32a-c730-48c4-a6f6-813c803d484d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:36.656073 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0298a32a-c730-48c4-a6f6-813c803d484d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:36.656462 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0298a32a-c730-48c4-a6f6-813c803d484d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:36.657623 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0298a32a-c730-48c4-a6f6-813c803d484d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:36.658411 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0298a32a-c730-48c4-a6f6-813c803d484d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:36.659635 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0298a32a-c730-48c4-a6f6-813c803d484d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:36.677938 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-0298a32a-c730-48c4-a6f6-813c803d484d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] HTTP exception thrown: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0298a32a-c730-48c4-a6f6-813c803d484d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Request method failure captured: Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab HTTP/1.1 Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhytX4Fqrx49tZr8XMSeqOuiVVe5QhR5pSkx822MlHR1MwQprRFdpyDwzWSFm2fCfS3S5s_QIudHlvHUSGGla4ObJvPgMlXRPp30GlwXPuRdB_YwvXPaPkzMw2fsaqcBcgnloHZe9knHcPTV7sOfEXdhYljLTd7gzyDjmltPZHCDm9w Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:33:36.679610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:33:36.681176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba3bab98d31d49098a8e7242d51be646", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:33:36.681176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:33:36.681176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:33:36.681176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:33:36.681176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:33:36.681176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:33:36.681176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:33:36.681176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 47965dc7f5964bbfa4efff0822530965 Nov 02 07:33:36.681176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:33:36.681176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:33:36.681176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. Nov 02 07:33:36.681176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': '793f8cfa-443a-4695-861e-6ba4c4e441ab'} Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:33:36.682047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. Nov 02 07:33:36.683545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:33:36.684837 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0298a32a-c730-48c4-a6f6-813c803d484d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Returning 404 to user: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:33:36.684837 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0298a32a-c730-48c4-a6f6-813c803d484d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 404 len: 111 microversion: 2.1 time: 0.045536 Nov 02 07:33:36.685341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 278/545] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:36 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:33:36.698310 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c7cb2a29-b29f-477b-a098-4ebd8a46cc02 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '.version_select at 0x7f4d6a22d1f0>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:36.718500 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c7cb2a29-b29f-477b-a098-4ebd8a46cc02 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-375419057" status: 202 len: 0 microversion: 2.1 time: 0.028455 Nov 02 07:33:36.719086 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 268/546] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 07:33:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-375419057 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 07:33:37.343398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-65edc360-6c39-49aa-907e-e0316287317d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Action: 'create', calling method: .version_select at 0x7f4d6a2a38b0>, body: {"keypair": {"name": "tempest-keypair-1111093897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALHZTdMwaOvTWaACCCgDAaGucxFlDTBcJORNMsYnu8OFqDoEN9APlyDrU6eD55mePI+gM+UdOwhXIe2QmrMSdsh7D0MFuMIGuRXnKaKfGqBa4whnql++B7+5nQ9qd1xwA=="}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:37.359712 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-65edc360-6c39-49aa-907e-e0316287317d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Getting quotas for project ba3bab98d31d49098a8e7242d51be646. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:33:37.363554 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-65edc360-6c39-49aa-907e-e0316287317d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Getting quotas for user 47965dc7f5964bbfa4efff0822530965 and project ba3bab98d31d49098a8e7242d51be646. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:33:37.385733 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-65edc360-6c39-49aa-907e-e0316287317d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046065 Nov 02 07:33:37.386116 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 279/547] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 07:33:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:33:38.637730 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-19168252", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db626555-8790-4323-a9e4-7db2e2eaf177"}], "security_groups": [{"name": "tempest-securitygroup--2092671006"}], "key_name": "tempest-keypair-1111093897", "user_data": "}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:38.742538 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.network.neutron [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] validate_networks() for [('db626555-8790-4323-a9e4-7db2e2eaf177', None, None, None, None, None)] {{(pid=118992) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:33:39.105411 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Flavor limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:33:39.105835 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Image limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:33:39.106312 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Flavor pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:33:39.106744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Image pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:33:39.107155 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:33:39.116026 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:39.116508 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:39.116946 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:39.117664 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:39.118114 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:39.118576 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:39.136436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Getting quotas for project ba3bab98d31d49098a8e7242d51be646. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:33:39.140347 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Getting quotas for user 47965dc7f5964bbfa4efff0822530965 and project ba3bab98d31d49098a8e7242d51be646. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:33:39.151996 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Going to run 1 instances... {{(pid=118992) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:33:39.154385 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:33:39.200259 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c325c4ad-3c7c-4a5c-b66f-c8d8e0d42c56 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.567195 Nov 02 07:33:39.200896 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 269/548] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:33:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 07:33:39.213534 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0e6e637f-e00d-41c2-b8bc-ff2815a61687 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:39.214136 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-0e6e637f-e00d-41c2-b8bc-ff2815a61687 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:39.270402 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0e6e637f-e00d-41c2-b8bc-ff2815a61687 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:39.277172 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0e6e637f-e00d-41c2-b8bc-ff2815a61687 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 200 len: 1240 microversion: 2.1 time: 0.067954 Nov 02 07:33:39.277740 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 280/549] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:39 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:40.301347 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a1798359-8e33-47c0-b8dd-f220a44f192f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:40.302064 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a1798359-8e33-47c0-b8dd-f220a44f192f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:40.308310 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a1798359-8e33-47c0-b8dd-f220a44f192f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:40.308785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a1798359-8e33-47c0-b8dd-f220a44f192f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:40.309209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a1798359-8e33-47c0-b8dd-f220a44f192f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:40.309889 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a1798359-8e33-47c0-b8dd-f220a44f192f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:40.310332 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a1798359-8e33-47c0-b8dd-f220a44f192f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:40.310768 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a1798359-8e33-47c0-b8dd-f220a44f192f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:40.380674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a1798359-8e33-47c0-b8dd-f220a44f192f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:40.389243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a1798359-8e33-47c0-b8dd-f220a44f192f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 200 len: 1292 microversion: 2.1 time: 0.093011 Nov 02 07:33:40.389813 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 270/550] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:40 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:41.413900 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-664e0e64-d1b6-47f3-9979-0f7de38b1f32 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:41.415196 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-664e0e64-d1b6-47f3-9979-0f7de38b1f32 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:41.422258 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-664e0e64-d1b6-47f3-9979-0f7de38b1f32 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:41.422830 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-664e0e64-d1b6-47f3-9979-0f7de38b1f32 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:41.423331 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-664e0e64-d1b6-47f3-9979-0f7de38b1f32 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:41.424084 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-664e0e64-d1b6-47f3-9979-0f7de38b1f32 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:41.424668 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-664e0e64-d1b6-47f3-9979-0f7de38b1f32 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:41.425267 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-664e0e64-d1b6-47f3-9979-0f7de38b1f32 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:41.623990 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-664e0e64-d1b6-47f3-9979-0f7de38b1f32 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:41.632767 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-664e0e64-d1b6-47f3-9979-0f7de38b1f32 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 200 len: 1366 microversion: 2.1 time: 0.222910 Nov 02 07:33:41.633335 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 281/551] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:41 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:41.941894 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-ba2515aa-96e4-463f-82de-cdf8d84dcd29 req-7e7e81a3-8438-4238-8435-f341f48c0b9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd1bfac-3396-4f20-bb69-0ce371638a22", "tag": "148621bd-7213-4c12-9515-64da33ea6ed5"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:41.953554 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-ba2515aa-96e4-463f-82de-cdf8d84dcd29 req-7e7e81a3-8438-4238-8435-f341f48c0b9a service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:41.953999 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-ba2515aa-96e4-463f-82de-cdf8d84dcd29 req-7e7e81a3-8438-4238-8435-f341f48c0b9a service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:41.954767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-ba2515aa-96e4-463f-82de-cdf8d84dcd29 req-7e7e81a3-8438-4238-8435-f341f48c0b9a service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:41.965976 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-ba2515aa-96e4-463f-82de-cdf8d84dcd29 req-7e7e81a3-8438-4238-8435-f341f48c0b9a service nova] Creating event network-changed:148621bd-7213-4c12-9515-64da33ea6ed5 for instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 on hv-cinder-80473 Nov 02 07:33:41.970571 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-ba2515aa-96e4-463f-82de-cdf8d84dcd29 req-7e7e81a3-8438-4238-8435-f341f48c0b9a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032575 Nov 02 07:33:41.971156 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 271/552] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:33:42.656734 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b41c2aa3-6266-4896-a9f0-dc4b1af90cb4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:42.657336 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b41c2aa3-6266-4896-a9f0-dc4b1af90cb4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:42.663931 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b41c2aa3-6266-4896-a9f0-dc4b1af90cb4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:42.664391 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b41c2aa3-6266-4896-a9f0-dc4b1af90cb4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:42.664804 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b41c2aa3-6266-4896-a9f0-dc4b1af90cb4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:42.665491 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b41c2aa3-6266-4896-a9f0-dc4b1af90cb4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:42.665940 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b41c2aa3-6266-4896-a9f0-dc4b1af90cb4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:42.666379 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b41c2aa3-6266-4896-a9f0-dc4b1af90cb4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:42.804551 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b41c2aa3-6266-4896-a9f0-dc4b1af90cb4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:42.812316 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b41c2aa3-6266-4896-a9f0-dc4b1af90cb4 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 200 len: 1366 microversion: 2.1 time: 0.159517 Nov 02 07:33:42.812858 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 282/553] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:42 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:43.836504 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-5d3b8ce4-e190-4a1d-87f4-44cb5bea3231 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:43.837292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-5d3b8ce4-e190-4a1d-87f4-44cb5bea3231 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:43.843834 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5d3b8ce4-e190-4a1d-87f4-44cb5bea3231 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:43.844324 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5d3b8ce4-e190-4a1d-87f4-44cb5bea3231 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:43.844758 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5d3b8ce4-e190-4a1d-87f4-44cb5bea3231 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:43.845451 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5d3b8ce4-e190-4a1d-87f4-44cb5bea3231 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:43.845902 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5d3b8ce4-e190-4a1d-87f4-44cb5bea3231 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:43.846354 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5d3b8ce4-e190-4a1d-87f4-44cb5bea3231 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:44.066427 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-5d3b8ce4-e190-4a1d-87f4-44cb5bea3231 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:44.074680 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-5d3b8ce4-e190-4a1d-87f4-44cb5bea3231 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 200 len: 1366 microversion: 2.1 time: 0.243104 Nov 02 07:33:44.075338 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 272/554] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:43 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:33:45.098123 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-4cc0400f-aa9d-4979-838b-0db7ee53d31d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:45.098760 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-4cc0400f-aa9d-4979-838b-0db7ee53d31d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:45.105244 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4cc0400f-aa9d-4979-838b-0db7ee53d31d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:45.105719 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4cc0400f-aa9d-4979-838b-0db7ee53d31d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:45.106148 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4cc0400f-aa9d-4979-838b-0db7ee53d31d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:45.106855 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4cc0400f-aa9d-4979-838b-0db7ee53d31d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:45.107302 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4cc0400f-aa9d-4979-838b-0db7ee53d31d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:45.107721 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4cc0400f-aa9d-4979-838b-0db7ee53d31d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:45.234277 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-4cc0400f-aa9d-4979-838b-0db7ee53d31d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:45.243010 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-4cc0400f-aa9d-4979-838b-0db7ee53d31d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 200 len: 1366 microversion: 2.1 time: 0.148980 Nov 02 07:33:45.243555 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 283/555] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:45 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:46.266678 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ece15ca7-e3bd-407a-8772-db7bb0dbab44 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:46.267298 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ece15ca7-e3bd-407a-8772-db7bb0dbab44 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:46.274220 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ece15ca7-e3bd-407a-8772-db7bb0dbab44 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:46.274733 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ece15ca7-e3bd-407a-8772-db7bb0dbab44 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:46.275166 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ece15ca7-e3bd-407a-8772-db7bb0dbab44 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:46.275852 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ece15ca7-e3bd-407a-8772-db7bb0dbab44 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:46.276304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ece15ca7-e3bd-407a-8772-db7bb0dbab44 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:46.276728 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ece15ca7-e3bd-407a-8772-db7bb0dbab44 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:46.410648 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ece15ca7-e3bd-407a-8772-db7bb0dbab44 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:46.418288 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ece15ca7-e3bd-407a-8772-db7bb0dbab44 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 200 len: 1366 microversion: 2.1 time: 0.155618 Nov 02 07:33:46.418883 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 273/556] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:46 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:47.442291 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-9dfd7a76-de83-41c0-adc7-3b5845f18144 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:47.442929 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-9dfd7a76-de83-41c0-adc7-3b5845f18144 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:47.450260 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9dfd7a76-de83-41c0-adc7-3b5845f18144 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:47.450774 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9dfd7a76-de83-41c0-adc7-3b5845f18144 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:47.451246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9dfd7a76-de83-41c0-adc7-3b5845f18144 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:47.451940 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9dfd7a76-de83-41c0-adc7-3b5845f18144 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:47.452393 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9dfd7a76-de83-41c0-adc7-3b5845f18144 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:47.452815 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9dfd7a76-de83-41c0-adc7-3b5845f18144 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:47.580231 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-9dfd7a76-de83-41c0-adc7-3b5845f18144 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:47.588414 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-9dfd7a76-de83-41c0-adc7-3b5845f18144 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 200 len: 1366 microversion: 2.1 time: 0.150106 Nov 02 07:33:47.589016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 284/557] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:47 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:47.964156 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-964332ef-b34d-4f46-8eaa-7b23bdfa0ecf req-9454db13-8cc8-4765-9e40-04d161e5904c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bd1bfac-3396-4f20-bb69-0ce371638a22", "name": "network-vif-plugged", "status": "completed", "tag": "148621bd-7213-4c12-9515-64da33ea6ed5"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:47.975893 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-964332ef-b34d-4f46-8eaa-7b23bdfa0ecf req-9454db13-8cc8-4765-9e40-04d161e5904c service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:47.976380 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-964332ef-b34d-4f46-8eaa-7b23bdfa0ecf req-9454db13-8cc8-4765-9e40-04d161e5904c service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:47.976835 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-964332ef-b34d-4f46-8eaa-7b23bdfa0ecf req-9454db13-8cc8-4765-9e40-04d161e5904c service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:47.987839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-964332ef-b34d-4f46-8eaa-7b23bdfa0ecf req-9454db13-8cc8-4765-9e40-04d161e5904c service nova] Creating event network-vif-plugged:148621bd-7213-4c12-9515-64da33ea6ed5 for instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 on hv-cinder-80473 Nov 02 07:33:47.993128 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-964332ef-b34d-4f46-8eaa-7b23bdfa0ecf req-9454db13-8cc8-4765-9e40-04d161e5904c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032685 Nov 02 07:33:47.993719 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 274/558] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:33:48.611928 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-15beecbc-a2bd-42d6-9851-693a34179e5b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:48.612537 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-15beecbc-a2bd-42d6-9851-693a34179e5b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:48.618926 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-15beecbc-a2bd-42d6-9851-693a34179e5b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:48.619408 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-15beecbc-a2bd-42d6-9851-693a34179e5b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:48.619836 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-15beecbc-a2bd-42d6-9851-693a34179e5b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:48.621035 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-15beecbc-a2bd-42d6-9851-693a34179e5b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:48.621132 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-15beecbc-a2bd-42d6-9851-693a34179e5b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:48.621490 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-15beecbc-a2bd-42d6-9851-693a34179e5b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:48.755057 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-15beecbc-a2bd-42d6-9851-693a34179e5b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:48.762763 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-15beecbc-a2bd-42d6-9851-693a34179e5b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 200 len: 1366 microversion: 2.1 time: 0.154740 Nov 02 07:33:48.763324 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 285/559] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:48 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:49.788546 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7cfd8ec9-b904-454e-87ab-56f7bebedd35 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:49.789679 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-7cfd8ec9-b904-454e-87ab-56f7bebedd35 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:49.795680 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:49.796332 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=6 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:49.799501 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7cfd8ec9-b904-454e-87ab-56f7bebedd35 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:49.800142 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7cfd8ec9-b904-454e-87ab-56f7bebedd35 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:49.800575 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7cfd8ec9-b904-454e-87ab-56f7bebedd35 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:49.801322 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7cfd8ec9-b904-454e-87ab-56f7bebedd35 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:49.801769 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7cfd8ec9-b904-454e-87ab-56f7bebedd35 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:49.802187 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7cfd8ec9-b904-454e-87ab-56f7bebedd35 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:49.949751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-7cfd8ec9-b904-454e-87ab-56f7bebedd35 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:49.958620 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-7cfd8ec9-b904-454e-87ab-56f7bebedd35 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 200 len: 1556 microversion: 2.1 time: 0.175194 Nov 02 07:33:49.959203 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 275/560] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:49 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:49.982093 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-04b7d5ac-215c-4253-861b-a2704b324b9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:49.982689 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-04b7d5ac-215c-4253-861b-a2704b324b9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:49.984571 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=6 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:49.991439 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-04b7d5ac-215c-4253-861b-a2704b324b9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:49.991960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-04b7d5ac-215c-4253-861b-a2704b324b9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:49.992390 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-04b7d5ac-215c-4253-861b-a2704b324b9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:49.993128 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-04b7d5ac-215c-4253-861b-a2704b324b9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:49.993624 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-04b7d5ac-215c-4253-861b-a2704b324b9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:49.994133 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-04b7d5ac-215c-4253-861b-a2704b324b9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:50.073867 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-04b7d5ac-215c-4253-861b-a2704b324b9d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095644 Nov 02 07:33:50.074765 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 286/561] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 07:33:49 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:33:50.982728 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-8b74076c-facb-4723-9427-505ba1b129af req-734307c2-0d3b-4b1a-8e11-fedf11786a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd1bfac-3396-4f20-bb69-0ce371638a22", "tag": "148621bd-7213-4c12-9515-64da33ea6ed5"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:50.993188 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-8b74076c-facb-4723-9427-505ba1b129af req-734307c2-0d3b-4b1a-8e11-fedf11786a35 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:50.993748 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-8b74076c-facb-4723-9427-505ba1b129af req-734307c2-0d3b-4b1a-8e11-fedf11786a35 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:50.994182 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-8b74076c-facb-4723-9427-505ba1b129af req-734307c2-0d3b-4b1a-8e11-fedf11786a35 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:51.005462 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-8b74076c-facb-4723-9427-505ba1b129af req-734307c2-0d3b-4b1a-8e11-fedf11786a35 service nova] Creating event network-changed:148621bd-7213-4c12-9515-64da33ea6ed5 for instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 on hv-cinder-80473 Nov 02 07:33:51.010340 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-8b74076c-facb-4723-9427-505ba1b129af req-734307c2-0d3b-4b1a-8e11-fedf11786a35 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031320 Nov 02 07:33:51.010966 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 276/562] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:33:51.361368 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-bff24fcc-0c03-4fd5-a464-021290504450 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:51.361919 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-bff24fcc-0c03-4fd5-a464-021290504450 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:51.368999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bff24fcc-0c03-4fd5-a464-021290504450 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:51.370055 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bff24fcc-0c03-4fd5-a464-021290504450 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:51.370530 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bff24fcc-0c03-4fd5-a464-021290504450 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:51.371324 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bff24fcc-0c03-4fd5-a464-021290504450 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:51.371855 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bff24fcc-0c03-4fd5-a464-021290504450 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:51.372348 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bff24fcc-0c03-4fd5-a464-021290504450 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:51.400245 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-bff24fcc-0c03-4fd5-a464-021290504450 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Going to try to terminate instance {{(pid=118991) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:33:51.491416 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-bff24fcc-0c03-4fd5-a464-021290504450 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 204 len: 0 microversion: 2.1 time: 0.134507 Nov 02 07:33:51.494565 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 287/563] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:33:51 2022] DELETE /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:33:51.503186 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0e06bdc8-9d12-49aa-b0ba-04619f5ef030 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:51.504555 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-0e06bdc8-9d12-49aa-b0ba-04619f5ef030 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:51.511289 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0e06bdc8-9d12-49aa-b0ba-04619f5ef030 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:51.511779 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0e06bdc8-9d12-49aa-b0ba-04619f5ef030 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:51.512214 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0e06bdc8-9d12-49aa-b0ba-04619f5ef030 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:51.512999 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0e06bdc8-9d12-49aa-b0ba-04619f5ef030 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:51.513457 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0e06bdc8-9d12-49aa-b0ba-04619f5ef030 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:51.513881 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0e06bdc8-9d12-49aa-b0ba-04619f5ef030 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:51.652799 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-0e06bdc8-9d12-49aa-b0ba-04619f5ef030 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:51.661351 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-0e06bdc8-9d12-49aa-b0ba-04619f5ef030 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1577 microversion: 2.1 time: 0.164001 Nov 02 07:33:51.662011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 277/564] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:51 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:52.685600 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-938a19b3-b98a-4201-9630-bd18788143a8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:52.686329 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-938a19b3-b98a-4201-9630-bd18788143a8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:52.693797 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-938a19b3-b98a-4201-9630-bd18788143a8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:52.694306 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-938a19b3-b98a-4201-9630-bd18788143a8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:52.694768 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-938a19b3-b98a-4201-9630-bd18788143a8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:52.695448 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-938a19b3-b98a-4201-9630-bd18788143a8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:52.695898 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-938a19b3-b98a-4201-9630-bd18788143a8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:52.696322 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-938a19b3-b98a-4201-9630-bd18788143a8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:52.901720 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-938a19b3-b98a-4201-9630-bd18788143a8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:52.909436 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-938a19b3-b98a-4201-9630-bd18788143a8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1577 microversion: 2.1 time: 0.228119 Nov 02 07:33:52.910091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 288/565] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:52 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1577 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:53.932252 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-96d81d27-d5d1-4f7c-95cd-2fbd2f1f3b71 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:53.932871 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-96d81d27-d5d1-4f7c-95cd-2fbd2f1f3b71 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:53.936476 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:53.941093 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-96d81d27-d5d1-4f7c-95cd-2fbd2f1f3b71 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:53.942819 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-96d81d27-d5d1-4f7c-95cd-2fbd2f1f3b71 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:53.943292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-96d81d27-d5d1-4f7c-95cd-2fbd2f1f3b71 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:53.944009 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-96d81d27-d5d1-4f7c-95cd-2fbd2f1f3b71 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:53.944467 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-96d81d27-d5d1-4f7c-95cd-2fbd2f1f3b71 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:53.944896 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-96d81d27-d5d1-4f7c-95cd-2fbd2f1f3b71 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:54.041691 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-96d81d27-d5d1-4f7c-95cd-2fbd2f1f3b71 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:54.049514 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-96d81d27-d5d1-4f7c-95cd-2fbd2f1f3b71 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1509 microversion: 2.1 time: 0.121080 Nov 02 07:33:54.050080 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 278/566] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:53 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1509 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:33:54.218960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-5b87d9fb-a8a6-48dd-bf4a-a230881ad898 req-594956f6-eb6f-4c2c-94c5-0577ecac4ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c89d505-bb4e-469f-bcb9-c336439e865a", "name": "network-vif-deleted", "tag": "417309a1-1746-4c69-89dd-ecf6b6199572"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:54.229669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-5b87d9fb-a8a6-48dd-bf4a-a230881ad898 req-594956f6-eb6f-4c2c-94c5-0577ecac4ce7 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:54.230141 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-5b87d9fb-a8a6-48dd-bf4a-a230881ad898 req-594956f6-eb6f-4c2c-94c5-0577ecac4ce7 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:54.230595 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-5b87d9fb-a8a6-48dd-bf4a-a230881ad898 req-594956f6-eb6f-4c2c-94c5-0577ecac4ce7 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:54.242039 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-5b87d9fb-a8a6-48dd-bf4a-a230881ad898 req-594956f6-eb6f-4c2c-94c5-0577ecac4ce7 service nova] Creating event network-vif-deleted:417309a1-1746-4c69-89dd-ecf6b6199572 for instance 4c89d505-bb4e-469f-bcb9-c336439e865a on hv-cinder-80473 Nov 02 07:33:54.247139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-5b87d9fb-a8a6-48dd-bf4a-a230881ad898 req-594956f6-eb6f-4c2c-94c5-0577ecac4ce7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031812 Nov 02 07:33:54.248158 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 289/567] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:33:55.072915 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-57d28185-f4fb-4b84-844e-89e17fceeb7c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:55.073518 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-57d28185-f4fb-4b84-844e-89e17fceeb7c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:55.079978 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-57d28185-f4fb-4b84-844e-89e17fceeb7c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:55.080453 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-57d28185-f4fb-4b84-844e-89e17fceeb7c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:55.080875 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-57d28185-f4fb-4b84-844e-89e17fceeb7c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:55.081572 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-57d28185-f4fb-4b84-844e-89e17fceeb7c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:55.082729 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-57d28185-f4fb-4b84-844e-89e17fceeb7c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:55.083246 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-57d28185-f4fb-4b84-844e-89e17fceeb7c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:55.114691 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-57d28185-f4fb-4b84-844e-89e17fceeb7c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:55.115090 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-57d28185-f4fb-4b84-844e-89e17fceeb7c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:55.115516 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-57d28185-f4fb-4b84-844e-89e17fceeb7c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:55.115959 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-57d28185-f4fb-4b84-844e-89e17fceeb7c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lazy-loading 'fault' on Instance uuid 4c89d505-bb4e-469f-bcb9-c336439e865a {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:33:55.156700 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-57d28185-f4fb-4b84-844e-89e17fceeb7c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:55.165271 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-57d28185-f4fb-4b84-844e-89e17fceeb7c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 200 len: 1229 microversion: 2.1 time: 0.096361 Nov 02 07:33:55.165842 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 279/568] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:55 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:33:56.189199 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-76fc6aea-60e5-4dcb-a98e-08e0b52c5343 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:56.189895 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-76fc6aea-60e5-4dcb-a98e-08e0b52c5343 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:56.196625 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-76fc6aea-60e5-4dcb-a98e-08e0b52c5343 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:56.197099 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-76fc6aea-60e5-4dcb-a98e-08e0b52c5343 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:56.197530 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-76fc6aea-60e5-4dcb-a98e-08e0b52c5343 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:56.198212 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-76fc6aea-60e5-4dcb-a98e-08e0b52c5343 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:56.198695 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-76fc6aea-60e5-4dcb-a98e-08e0b52c5343 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:56.199116 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-76fc6aea-60e5-4dcb-a98e-08e0b52c5343 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:56.212795 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-76fc6aea-60e5-4dcb-a98e-08e0b52c5343 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] HTTP exception thrown: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-76fc6aea-60e5-4dcb-a98e-08e0b52c5343 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Request method failure captured: Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a HTTP/1.1 Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhyTWk-O_OqLu_QeVTQLGezpCiVh9Jp0zHNg2lqfT0Png45XS8EJWyhymALQ_6L6XTxU4HFylmj21NenAQlCkR84qrUm5z1Lzuu7Dh1GHFETRqOJvY3lOx3YMLbR2dPAhbN8QKpf63w7T_Rznuj0YxzoXwF5Rmr0Z1LIXpdwGvvj_W0 Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: 566514b413e24aaebe69c11ce2159ac9 Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-TestVolumeBootPattern-383952907 Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:33:56.214452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:33:56.216077 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_566514b413e24aaebe69c11ce2159ac9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/566514b413e24aaebe69c11ce2159ac9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/566514b413e24aaebe69c11ce2159ac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/566514b413e24aaebe69c11ce2159ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:33:56.216077 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-TestVolumeBootPattern-383952907 Nov 02 07:33:56.216077 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: 566514b413e24aaebe69c11ce2159ac9 Nov 02 07:33:56.216077 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-TestVolumeBootPattern-383952907 Nov 02 07:33:56.216077 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-TestVolumeBootPattern-383952907-project Nov 02 07:33:56.216077 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:33:56.216077 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:33:56.216077 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: fe26aea6bb9d4dcebf046da719b2c244 Nov 02 07:33:56.216077 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-TestVolumeBootPattern-383952907-project Nov 02 07:33:56.216077 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:33:56.216077 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. Nov 02 07:33:56.216077 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': '4c89d505-bb4e-469f-bcb9-c336439e865a'} Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:33:56.216977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. Nov 02 07:33:56.218198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:33:56.219323 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-76fc6aea-60e5-4dcb-a98e-08e0b52c5343 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Returning 404 to user: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:33:56.219323 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-76fc6aea-60e5-4dcb-a98e-08e0b52c5343 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 404 len: 111 microversion: 2.1 time: 0.031413 Nov 02 07:33:56.219323 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 290/569] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:56 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:33:56.310681 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-841120827", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-823697442", "security_groups": [{"name": "tempest-secgroup-smoke-1042148425"}], "block_device_mapping_v2": [{"uuid": "f178cb83-3ae8-4fc1-ae6c-3a94daee8c2a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6809857-e0de-42f0-baa8-be80912a85f1"}]}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:33:56.427504 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.network.neutron [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] validate_networks() for [('f6809857-e0de-42f0-baa8-be80912a85f1', None, None, None, None, None)] {{(pid=118992) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:33:56.800155 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Flavor limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:33:56.800603 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Image limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:33:56.801760 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Flavor pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:33:56.802533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Image pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:33:56.803982 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:33:56.813845 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:56.814326 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:56.814788 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:56.815502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:56.815950 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:56.816432 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:56.837106 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Getting quotas for project 566514b413e24aaebe69c11ce2159ac9. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:33:56.841210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Getting quotas for user fe26aea6bb9d4dcebf046da719b2c244 and project 566514b413e24aaebe69c11ce2159ac9. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:33:56.907284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Going to run 1 instances... {{(pid=118992) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:33:56.909686 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f178cb83-3ae8-4fc1-ae6c-3a94daee8c2a',volume_size=None,volume_type=None)] {{(pid=118992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:33:57.057723 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-1900a02f-cf86-4d42-acaa-8691c35868e3 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.750755 Nov 02 07:33:57.058291 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 280/570] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:33:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 07:33:57.071852 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-e1d4f251-a614-4c28-bc38-a6d28c13413c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:57.072463 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-e1d4f251-a614-4c28-bc38-a6d28c13413c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:57.145274 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e1d4f251-a614-4c28-bc38-a6d28c13413c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:57.152812 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e1d4f251-a614-4c28-bc38-a6d28c13413c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1093 microversion: 2.1 time: 0.084891 Nov 02 07:33:57.153379 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 291/571] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:57 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1093 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:33:58.177479 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9f2a3061-bc45-49d6-b913-ad7402f18ee1 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:58.178008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9f2a3061-bc45-49d6-b913-ad7402f18ee1 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:58.184045 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f2a3061-bc45-49d6-b913-ad7402f18ee1 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:58.184535 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f2a3061-bc45-49d6-b913-ad7402f18ee1 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:58.184944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f2a3061-bc45-49d6-b913-ad7402f18ee1 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:58.185623 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f2a3061-bc45-49d6-b913-ad7402f18ee1 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:58.186071 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f2a3061-bc45-49d6-b913-ad7402f18ee1 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:58.186515 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f2a3061-bc45-49d6-b913-ad7402f18ee1 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:58.247272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9f2a3061-bc45-49d6-b913-ad7402f18ee1 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:58.255923 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9f2a3061-bc45-49d6-b913-ad7402f18ee1 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1191 microversion: 2.1 time: 0.083565 Nov 02 07:33:58.256492 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 281/572] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:58 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:33:59.244275 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b921915b-f85d-4194-be79-cf0464197b09 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:59.245044 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b921915b-f85d-4194-be79-cf0464197b09 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:59.253658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b921915b-f85d-4194-be79-cf0464197b09 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:59.254889 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b921915b-f85d-4194-be79-cf0464197b09 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:59.255615 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b921915b-f85d-4194-be79-cf0464197b09 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:59.256548 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b921915b-f85d-4194-be79-cf0464197b09 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:59.256991 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b921915b-f85d-4194-be79-cf0464197b09 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:59.257398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b921915b-f85d-4194-be79-cf0464197b09 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:59.279392 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9e9792eb-dcf9-44ae-a911-aabfa77dfab6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:59.279997 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9e9792eb-dcf9-44ae-a911-aabfa77dfab6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:59.287707 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9e9792eb-dcf9-44ae-a911-aabfa77dfab6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:59.289062 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9e9792eb-dcf9-44ae-a911-aabfa77dfab6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:59.289773 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9e9792eb-dcf9-44ae-a911-aabfa77dfab6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:59.290862 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9e9792eb-dcf9-44ae-a911-aabfa77dfab6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:59.291526 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9e9792eb-dcf9-44ae-a911-aabfa77dfab6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:59.292193 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9e9792eb-dcf9-44ae-a911-aabfa77dfab6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:59.371259 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.objects.instance [None req-b921915b-f85d-4194-be79-cf0464197b09 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lazy-loading 'services' on Instance uuid 7f8c1657-4f0c-4856-aa2f-7536a549ad16 {{(pid=118991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:33:59.444564 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:59.458966 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b921915b-f85d-4194-be79-cf0464197b09 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/os-volume_attachments/4a2a9f03-dcb2-4f49-94df-b7166fc1f05e" status: 202 len: 0 microversion: 2.1 time: 0.217896 Nov 02 07:33:59.463442 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 292/573] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 07:33:59 2022] DELETE /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/os-volume_attachments/4a2a9f03-dcb2-4f49-94df-b7166fc1f05e => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:33:59.469758 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8acd41bb-462b-411a-8cdb-3081922b8ab3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:33:59.472277 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8acd41bb-462b-411a-8cdb-3081922b8ab3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:33:59.480509 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8acd41bb-462b-411a-8cdb-3081922b8ab3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:59.481106 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8acd41bb-462b-411a-8cdb-3081922b8ab3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:59.481621 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8acd41bb-462b-411a-8cdb-3081922b8ab3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:59.482413 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8acd41bb-462b-411a-8cdb-3081922b8ab3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:33:59.483114 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8acd41bb-462b-411a-8cdb-3081922b8ab3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:33:59.483763 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8acd41bb-462b-411a-8cdb-3081922b8ab3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:33:59.517173 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8acd41bb-462b-411a-8cdb-3081922b8ab3 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051645 Nov 02 07:33:59.522507 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 293/574] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 07:33:59 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:33:59.543349 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9e9792eb-dcf9-44ae-a911-aabfa77dfab6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:33:59.551415 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9e9792eb-dcf9-44ae-a911-aabfa77dfab6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1265 microversion: 2.1 time: 0.275951 Nov 02 07:33:59.552206 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 282/575] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:33:59 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:00.137484 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-b21ac1dc-c13f-4c33-91ed-d2e40092d202 req-a8538159-aa26-475e-8071-a3fc1343b6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b63e70e7-b2ef-4b6e-9457-7f92d1adc30b", "tag": "5170ac1a-792e-408b-9e77-31d91e95efd5"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:00.147459 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-b21ac1dc-c13f-4c33-91ed-d2e40092d202 req-a8538159-aa26-475e-8071-a3fc1343b6c1 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:00.147798 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-b21ac1dc-c13f-4c33-91ed-d2e40092d202 req-a8538159-aa26-475e-8071-a3fc1343b6c1 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:00.148418 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-b21ac1dc-c13f-4c33-91ed-d2e40092d202 req-a8538159-aa26-475e-8071-a3fc1343b6c1 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:00.162666 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-b21ac1dc-c13f-4c33-91ed-d2e40092d202 req-a8538159-aa26-475e-8071-a3fc1343b6c1 service nova] Creating event network-changed:5170ac1a-792e-408b-9e77-31d91e95efd5 for instance b63e70e7-b2ef-4b6e-9457-7f92d1adc30b on hv-cinder-80473 Nov 02 07:34:00.168232 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-b21ac1dc-c13f-4c33-91ed-d2e40092d202 req-a8538159-aa26-475e-8071-a3fc1343b6c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034399 Nov 02 07:34:00.169101 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 294/576] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:34:00.530137 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c756f267-ce41-43bf-8013-e3ef9690dfbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:00.532423 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c756f267-ce41-43bf-8013-e3ef9690dfbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:00.538999 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c756f267-ce41-43bf-8013-e3ef9690dfbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:00.539488 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c756f267-ce41-43bf-8013-e3ef9690dfbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:00.539922 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c756f267-ce41-43bf-8013-e3ef9690dfbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:00.540620 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c756f267-ce41-43bf-8013-e3ef9690dfbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:00.541257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c756f267-ce41-43bf-8013-e3ef9690dfbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:00.541684 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c756f267-ce41-43bf-8013-e3ef9690dfbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:00.567511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=100 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:00.572666 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c756f267-ce41-43bf-8013-e3ef9690dfbc tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046449 Nov 02 07:34:00.573240 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 283/577] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 07:34:00 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 07:34:00.575685 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b94022c6-f70b-478b-bd64-c5c277873205 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:00.576385 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b94022c6-f70b-478b-bd64-c5c277873205 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:00.583296 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b94022c6-f70b-478b-bd64-c5c277873205 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:00.583837 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b94022c6-f70b-478b-bd64-c5c277873205 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:00.584555 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b94022c6-f70b-478b-bd64-c5c277873205 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:00.585333 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b94022c6-f70b-478b-bd64-c5c277873205 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:00.585822 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b94022c6-f70b-478b-bd64-c5c277873205 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:00.586234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b94022c6-f70b-478b-bd64-c5c277873205 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:00.662188 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-fc8a1d7d-2846-4c9e-b504-8f8350910e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:00.662805 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-fc8a1d7d-2846-4c9e-b504-8f8350910e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:00.670238 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc8a1d7d-2846-4c9e-b504-8f8350910e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:00.671087 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc8a1d7d-2846-4c9e-b504-8f8350910e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:00.671750 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc8a1d7d-2846-4c9e-b504-8f8350910e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:00.672690 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc8a1d7d-2846-4c9e-b504-8f8350910e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:00.673230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc8a1d7d-2846-4c9e-b504-8f8350910e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:00.673674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc8a1d7d-2846-4c9e-b504-8f8350910e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:00.700007 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-fc8a1d7d-2846-4c9e-b504-8f8350910e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Going to try to terminate instance {{(pid=118992) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:34:00.733033 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b94022c6-f70b-478b-bd64-c5c277873205 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:00.741789 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b94022c6-f70b-478b-bd64-c5c277873205 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1265 microversion: 2.1 time: 0.170699 Nov 02 07:34:00.742899 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 295/578] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:00 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:34:00.776733 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-fc8a1d7d-2846-4c9e-b504-8f8350910e08 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 204 len: 0 microversion: 2.1 time: 0.119587 Nov 02 07:34:00.777303 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 284/579] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:34:00 2022] DELETE /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 07:34:00.786036 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-65781ac6-54b9-4c38-aca5-e1415f0dcdff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:00.786674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-65781ac6-54b9-4c38-aca5-e1415f0dcdff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:00.794068 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-65781ac6-54b9-4c38-aca5-e1415f0dcdff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:00.794579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-65781ac6-54b9-4c38-aca5-e1415f0dcdff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:00.795010 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-65781ac6-54b9-4c38-aca5-e1415f0dcdff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:00.795691 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-65781ac6-54b9-4c38-aca5-e1415f0dcdff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:00.796132 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-65781ac6-54b9-4c38-aca5-e1415f0dcdff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:00.796548 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-65781ac6-54b9-4c38-aca5-e1415f0dcdff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:00.926986 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-65781ac6-54b9-4c38-aca5-e1415f0dcdff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:00.934574 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-65781ac6-54b9-4c38-aca5-e1415f0dcdff tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1689 microversion: 2.1 time: 0.153138 Nov 02 07:34:00.935132 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 296/580] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:00 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:01.765573 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-75475fac-a3c6-4f68-bdf3-d0b067067aac tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:01.766268 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-75475fac-a3c6-4f68-bdf3-d0b067067aac tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:01.772975 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75475fac-a3c6-4f68-bdf3-d0b067067aac tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:01.773456 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75475fac-a3c6-4f68-bdf3-d0b067067aac tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:01.773902 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75475fac-a3c6-4f68-bdf3-d0b067067aac tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:01.774625 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75475fac-a3c6-4f68-bdf3-d0b067067aac tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:01.775083 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75475fac-a3c6-4f68-bdf3-d0b067067aac tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:01.775505 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75475fac-a3c6-4f68-bdf3-d0b067067aac tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:01.904698 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-75475fac-a3c6-4f68-bdf3-d0b067067aac tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:01.912328 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-75475fac-a3c6-4f68-bdf3-d0b067067aac tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1265 microversion: 2.1 time: 0.150992 Nov 02 07:34:01.912891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 285/581] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:01 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:01.957842 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-6196cd39-b673-4055-ab93-6ce50babb147 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:01.958471 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-6196cd39-b673-4055-ab93-6ce50babb147 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:01.960939 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:01.966322 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6196cd39-b673-4055-ab93-6ce50babb147 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:01.966828 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6196cd39-b673-4055-ab93-6ce50babb147 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:01.967258 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6196cd39-b673-4055-ab93-6ce50babb147 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:01.967933 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6196cd39-b673-4055-ab93-6ce50babb147 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:01.968379 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6196cd39-b673-4055-ab93-6ce50babb147 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:01.968793 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6196cd39-b673-4055-ab93-6ce50babb147 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:02.098821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-6196cd39-b673-4055-ab93-6ce50babb147 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:02.106497 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-6196cd39-b673-4055-ab93-6ce50babb147 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1689 microversion: 2.1 time: 0.152515 Nov 02 07:34:02.106989 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 297/582] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:01 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:02.935439 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ba57724f-126e-4141-b9ed-d44f1cdf682c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:02.935965 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ba57724f-126e-4141-b9ed-d44f1cdf682c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:02.942559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ba57724f-126e-4141-b9ed-d44f1cdf682c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:02.943046 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ba57724f-126e-4141-b9ed-d44f1cdf682c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:02.943483 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ba57724f-126e-4141-b9ed-d44f1cdf682c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:02.944170 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ba57724f-126e-4141-b9ed-d44f1cdf682c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:02.944631 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ba57724f-126e-4141-b9ed-d44f1cdf682c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:02.945053 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ba57724f-126e-4141-b9ed-d44f1cdf682c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:03.076407 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ba57724f-126e-4141-b9ed-d44f1cdf682c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:03.084576 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ba57724f-126e-4141-b9ed-d44f1cdf682c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1265 microversion: 2.1 time: 0.153043 Nov 02 07:34:03.085180 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 286/583] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:02 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:03.130401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d70ec109-49fc-474d-a559-520227245319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:03.131012 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-d70ec109-49fc-474d-a559-520227245319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:03.137399 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d70ec109-49fc-474d-a559-520227245319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:03.137876 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d70ec109-49fc-474d-a559-520227245319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:03.138307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d70ec109-49fc-474d-a559-520227245319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:03.139020 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d70ec109-49fc-474d-a559-520227245319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:03.139465 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d70ec109-49fc-474d-a559-520227245319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:03.139886 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d70ec109-49fc-474d-a559-520227245319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:03.268419 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d70ec109-49fc-474d-a559-520227245319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:03.276501 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d70ec109-49fc-474d-a559-520227245319 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1689 microversion: 2.1 time: 0.149972 Nov 02 07:34:03.277060 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 298/584] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:03 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:04.108230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-5eb85d5a-572a-465e-a038-0bfee0ef2168 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:04.108945 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-5eb85d5a-572a-465e-a038-0bfee0ef2168 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:04.115524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5eb85d5a-572a-465e-a038-0bfee0ef2168 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:04.116000 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5eb85d5a-572a-465e-a038-0bfee0ef2168 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:04.116430 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5eb85d5a-572a-465e-a038-0bfee0ef2168 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:04.117111 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5eb85d5a-572a-465e-a038-0bfee0ef2168 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:04.117560 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5eb85d5a-572a-465e-a038-0bfee0ef2168 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:04.117984 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5eb85d5a-572a-465e-a038-0bfee0ef2168 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:04.249408 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-5eb85d5a-572a-465e-a038-0bfee0ef2168 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:04.257341 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-5eb85d5a-572a-465e-a038-0bfee0ef2168 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1265 microversion: 2.1 time: 0.152984 Nov 02 07:34:04.257898 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 287/585] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:04 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:04.300084 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-581e2256-96f2-4222-9de7-bb5c89ed0541 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:04.300709 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-581e2256-96f2-4222-9de7-bb5c89ed0541 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:04.307271 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-581e2256-96f2-4222-9de7-bb5c89ed0541 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:04.307744 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-581e2256-96f2-4222-9de7-bb5c89ed0541 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:04.308181 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-581e2256-96f2-4222-9de7-bb5c89ed0541 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:04.308869 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-581e2256-96f2-4222-9de7-bb5c89ed0541 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:04.309315 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-581e2256-96f2-4222-9de7-bb5c89ed0541 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:04.309737 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-581e2256-96f2-4222-9de7-bb5c89ed0541 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:04.437228 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-581e2256-96f2-4222-9de7-bb5c89ed0541 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:04.445542 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-581e2256-96f2-4222-9de7-bb5c89ed0541 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1689 microversion: 2.1 time: 0.149312 Nov 02 07:34:04.446108 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 299/586] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:04 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:05.281025 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-71732935-dad9-4c89-b451-c19e609c956e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:05.281645 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-71732935-dad9-4c89-b451-c19e609c956e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:05.288465 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-71732935-dad9-4c89-b451-c19e609c956e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:05.288968 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-71732935-dad9-4c89-b451-c19e609c956e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:05.289721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-71732935-dad9-4c89-b451-c19e609c956e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:05.290456 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-71732935-dad9-4c89-b451-c19e609c956e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:05.290912 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-71732935-dad9-4c89-b451-c19e609c956e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:05.291369 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-71732935-dad9-4c89-b451-c19e609c956e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:05.431982 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-71732935-dad9-4c89-b451-c19e609c956e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:05.439836 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-71732935-dad9-4c89-b451-c19e609c956e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1265 microversion: 2.1 time: 0.163183 Nov 02 07:34:05.440403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 288/587] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:05 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:05.469151 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-de4de734-8460-41bc-9dfb-03af3c333abe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:05.469795 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-de4de734-8460-41bc-9dfb-03af3c333abe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:05.477142 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-de4de734-8460-41bc-9dfb-03af3c333abe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:05.477630 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-de4de734-8460-41bc-9dfb-03af3c333abe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:05.478082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-de4de734-8460-41bc-9dfb-03af3c333abe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:05.478818 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-de4de734-8460-41bc-9dfb-03af3c333abe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:05.479263 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-de4de734-8460-41bc-9dfb-03af3c333abe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:05.479681 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-de4de734-8460-41bc-9dfb-03af3c333abe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:05.614506 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-de4de734-8460-41bc-9dfb-03af3c333abe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:05.622441 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-de4de734-8460-41bc-9dfb-03af3c333abe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1689 microversion: 2.1 time: 0.157284 Nov 02 07:34:05.623100 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 300/588] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:05 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:05.907815 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-02efc256-001b-4b91-9144-b35527a51f2d req-07c25ea3-e460-44a9-95eb-ce2a869efb95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8c1657-4f0c-4856-aa2f-7536a549ad16", "name": "network-vif-deleted", "tag": "47c195f9-fe3d-4872-a0a9-ef4120548d09"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:05.924087 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-02efc256-001b-4b91-9144-b35527a51f2d req-07c25ea3-e460-44a9-95eb-ce2a869efb95 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:05.924675 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-02efc256-001b-4b91-9144-b35527a51f2d req-07c25ea3-e460-44a9-95eb-ce2a869efb95 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:05.925232 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-02efc256-001b-4b91-9144-b35527a51f2d req-07c25ea3-e460-44a9-95eb-ce2a869efb95 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:05.936307 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-02efc256-001b-4b91-9144-b35527a51f2d req-07c25ea3-e460-44a9-95eb-ce2a869efb95 service nova] Creating event network-vif-deleted:47c195f9-fe3d-4872-a0a9-ef4120548d09 for instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 on hv-cinder-80473 Nov 02 07:34:05.941170 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-02efc256-001b-4b91-9144-b35527a51f2d req-07c25ea3-e460-44a9-95eb-ce2a869efb95 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037151 Nov 02 07:34:05.942353 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 289/589] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:34:06.462658 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-9a242ec3-299c-4089-84cb-2b061aba7109 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:06.463374 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-9a242ec3-299c-4089-84cb-2b061aba7109 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:06.469524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a242ec3-299c-4089-84cb-2b061aba7109 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:06.470148 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a242ec3-299c-4089-84cb-2b061aba7109 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:06.470462 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a242ec3-299c-4089-84cb-2b061aba7109 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:06.471157 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a242ec3-299c-4089-84cb-2b061aba7109 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:06.471610 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a242ec3-299c-4089-84cb-2b061aba7109 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:06.472034 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a242ec3-299c-4089-84cb-2b061aba7109 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:06.610230 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-9a242ec3-299c-4089-84cb-2b061aba7109 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:06.619479 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-9a242ec3-299c-4089-84cb-2b061aba7109 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1265 microversion: 2.1 time: 0.160665 Nov 02 07:34:06.620212 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 301/590] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:06 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:06.646875 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-843b19c9-4eab-4a35-9f71-9d0c398b36e2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:06.647603 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-843b19c9-4eab-4a35-9f71-9d0c398b36e2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:06.656664 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-843b19c9-4eab-4a35-9f71-9d0c398b36e2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:06.657198 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-843b19c9-4eab-4a35-9f71-9d0c398b36e2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:06.657671 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-843b19c9-4eab-4a35-9f71-9d0c398b36e2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:06.658411 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-843b19c9-4eab-4a35-9f71-9d0c398b36e2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:06.658894 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-843b19c9-4eab-4a35-9f71-9d0c398b36e2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:06.659323 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-843b19c9-4eab-4a35-9f71-9d0c398b36e2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:06.695399 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-843b19c9-4eab-4a35-9f71-9d0c398b36e2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:06.695899 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-843b19c9-4eab-4a35-9f71-9d0c398b36e2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:06.696336 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-843b19c9-4eab-4a35-9f71-9d0c398b36e2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:06.697032 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-843b19c9-4eab-4a35-9f71-9d0c398b36e2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lazy-loading 'fault' on Instance uuid 7f8c1657-4f0c-4856-aa2f-7536a549ad16 {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:34:06.741602 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-843b19c9-4eab-4a35-9f71-9d0c398b36e2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:06.749363 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-843b19c9-4eab-4a35-9f71-9d0c398b36e2 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 200 len: 1336 microversion: 2.1 time: 0.107536 Nov 02 07:34:06.749941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 290/591] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:06 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 1336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:07.643113 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-579c8c27-23c4-4fb9-81bb-35c1d1bf6ed6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:07.643730 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-579c8c27-23c4-4fb9-81bb-35c1d1bf6ed6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:07.645762 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:07.651073 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-579c8c27-23c4-4fb9-81bb-35c1d1bf6ed6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:07.651555 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-579c8c27-23c4-4fb9-81bb-35c1d1bf6ed6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:07.651989 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-579c8c27-23c4-4fb9-81bb-35c1d1bf6ed6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:07.652680 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-579c8c27-23c4-4fb9-81bb-35c1d1bf6ed6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:07.653131 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-579c8c27-23c4-4fb9-81bb-35c1d1bf6ed6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:07.653550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-579c8c27-23c4-4fb9-81bb-35c1d1bf6ed6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:07.774268 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1cb6445d-3d55-456e-91a8-2200df60140f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:07.775034 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1cb6445d-3d55-456e-91a8-2200df60140f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 7f8c1657-4f0c-4856-aa2f-7536a549ad16] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:07.777142 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:07.777994 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=6 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:07.784400 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1cb6445d-3d55-456e-91a8-2200df60140f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:07.784895 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1cb6445d-3d55-456e-91a8-2200df60140f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:07.785952 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-579c8c27-23c4-4fb9-81bb-35c1d1bf6ed6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:07.786558 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1cb6445d-3d55-456e-91a8-2200df60140f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:07.787284 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1cb6445d-3d55-456e-91a8-2200df60140f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:07.787746 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1cb6445d-3d55-456e-91a8-2200df60140f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:07.788177 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1cb6445d-3d55-456e-91a8-2200df60140f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:07.793751 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-579c8c27-23c4-4fb9-81bb-35c1d1bf6ed6 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1265 microversion: 2.1 time: 0.154640 Nov 02 07:34:07.794313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 302/592] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:07 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:07.804970 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-1cb6445d-3d55-456e-91a8-2200df60140f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] HTTP exception thrown: Instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 could not be found. Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1cb6445d-3d55-456e-91a8-2200df60140f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Request method failure captured: Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 HTTP/1.1 Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhxUEtNtZTs4ic7TO1YHq64wZsN5qBfs97ESDbbUSAfzzoKKF4aWoMtTWeaBh0tZLpMPcjYYxG24mgb4lumO_vWqHxQoVjCNp3JVn1PYMG7yUkIv-CwxwRq4pRuWrgDLhanWDwQK429gy3U8ZyWDQ8-vGuKkNzeaxCqAyS8AZk8aIVo Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: c60cb95cbf734d9b852af2bdcad4e1c0 Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-276708690 Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:34:07.806637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:34:07.807944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c60cb95cbf734d9b852af2bdcad4e1c0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c60cb95cbf734d9b852af2bdcad4e1c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c60cb95cbf734d9b852af2bdcad4e1c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c60cb95cbf734d9b852af2bdcad4e1c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:34:07.807944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-ServerRescueNegativeTestJSON-276708690 Nov 02 07:34:07.807944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: c60cb95cbf734d9b852af2bdcad4e1c0 Nov 02 07:34:07.807944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-276708690 Nov 02 07:34:07.807944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-ServerRescueNegativeTestJSON-276708690-project Nov 02 07:34:07.807944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:34:07.807944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:34:07.807944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 0e571b0f4d6f4fafb71939f501b8deec Nov 02 07:34:07.807944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-ServerRescueNegativeTestJSON-276708690-project Nov 02 07:34:07.807944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:34:07.807944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 could not be found. Nov 02 07:34:07.807944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '7f8c1657-4f0c-4856-aa2f-7536a549ad16'} Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 could not be found. Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:34:07.808833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 could not be found. Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 could not be found. Nov 02 07:34:07.810239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:34:07.811618 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1cb6445d-3d55-456e-91a8-2200df60140f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Returning 404 to user: Instance 7f8c1657-4f0c-4856-aa2f-7536a549ad16 could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:34:07.811618 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-1cb6445d-3d55-456e-91a8-2200df60140f tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16" status: 404 len: 111 microversion: 2.1 time: 0.038660 Nov 02 07:34:07.811618 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 291/593] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:07 2022] GET /compute/v2.1/servers/7f8c1657-4f0c-4856-aa2f-7536a549ad16 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:34:07.816416 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d17451a8-13c7-4061-bbe0-b023e32dc509 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '.version_select at 0x7f4d6a3a0940>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:07.835084 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d17451a8-13c7-4061-bbe0-b023e32dc509 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345587460" status: 202 len: 0 microversion: 2.1 time: 0.022314 Nov 02 07:34:07.835630 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 303/594] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Nov 2 07:34:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345587460 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:34:08.817057 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-fe382387-59ef-4a7c-9629-ba991621f927 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:08.817723 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-fe382387-59ef-4a7c-9629-ba991621f927 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:08.824184 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fe382387-59ef-4a7c-9629-ba991621f927 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:08.824672 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fe382387-59ef-4a7c-9629-ba991621f927 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:08.825104 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fe382387-59ef-4a7c-9629-ba991621f927 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:08.825801 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fe382387-59ef-4a7c-9629-ba991621f927 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:08.826250 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fe382387-59ef-4a7c-9629-ba991621f927 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:08.826711 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fe382387-59ef-4a7c-9629-ba991621f927 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:08.966476 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fe382387-59ef-4a7c-9629-ba991621f927 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:08.974188 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-fe382387-59ef-4a7c-9629-ba991621f927 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1265 microversion: 2.1 time: 0.161149 Nov 02 07:34:08.974800 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 292/595] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:08 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:09.998152 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-e0dc9643-5a56-405a-8a27-6e481039f5d9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:09.998791 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-e0dc9643-5a56-405a-8a27-6e481039f5d9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:10.005623 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e0dc9643-5a56-405a-8a27-6e481039f5d9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:10.006095 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e0dc9643-5a56-405a-8a27-6e481039f5d9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:10.006555 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e0dc9643-5a56-405a-8a27-6e481039f5d9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:10.007270 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e0dc9643-5a56-405a-8a27-6e481039f5d9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:10.007704 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e0dc9643-5a56-405a-8a27-6e481039f5d9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:10.008120 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e0dc9643-5a56-405a-8a27-6e481039f5d9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:10.141196 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e0dc9643-5a56-405a-8a27-6e481039f5d9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:10.148730 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e0dc9643-5a56-405a-8a27-6e481039f5d9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1265 microversion: 2.1 time: 0.155491 Nov 02 07:34:10.149283 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 304/596] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:09 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:10.536019 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-537e195c-1a15-4ea6-8e0e-53b4af97a494 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:10.536612 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-537e195c-1a15-4ea6-8e0e-53b4af97a494 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:10.543033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-537e195c-1a15-4ea6-8e0e-53b4af97a494 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:10.543519 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-537e195c-1a15-4ea6-8e0e-53b4af97a494 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:10.543954 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-537e195c-1a15-4ea6-8e0e-53b4af97a494 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:10.544647 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-537e195c-1a15-4ea6-8e0e-53b4af97a494 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:10.545095 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-537e195c-1a15-4ea6-8e0e-53b4af97a494 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:10.545519 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-537e195c-1a15-4ea6-8e0e-53b4af97a494 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:10.569117 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-537e195c-1a15-4ea6-8e0e-53b4af97a494 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284/ips" status: 200 len: 150 microversion: 2.20 time: 0.037565 Nov 02 07:34:10.569675 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 293/597] 10.222.0.18 () {60 vars in 1289 bytes} [Wed Nov 2 07:34:10 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 07:34:10.701590 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b6e47323-499e-4613-8dff-90e9f6551fbf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:10.702271 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b6e47323-499e-4613-8dff-90e9f6551fbf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:10.708595 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b6e47323-499e-4613-8dff-90e9f6551fbf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:10.709078 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b6e47323-499e-4613-8dff-90e9f6551fbf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:10.709510 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b6e47323-499e-4613-8dff-90e9f6551fbf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:10.710195 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b6e47323-499e-4613-8dff-90e9f6551fbf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:10.710744 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b6e47323-499e-4613-8dff-90e9f6551fbf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:10.711168 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b6e47323-499e-4613-8dff-90e9f6551fbf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:10.737005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b6e47323-499e-4613-8dff-90e9f6551fbf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Going to try to terminate instance {{(pid=118991) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:34:10.829355 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b6e47323-499e-4613-8dff-90e9f6551fbf tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "DELETE /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 204 len: 0 microversion: 2.1 time: 0.131360 Nov 02 07:34:10.830022 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 305/598] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:34:10 2022] DELETE /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:34:10.839512 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c9f64ec4-2378-44f9-b3e6-c0415117095e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:10.840137 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c9f64ec4-2378-44f9-b3e6-c0415117095e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:10.846435 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c9f64ec4-2378-44f9-b3e6-c0415117095e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:10.847097 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c9f64ec4-2378-44f9-b3e6-c0415117095e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:10.847829 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c9f64ec4-2378-44f9-b3e6-c0415117095e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:10.849503 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c9f64ec4-2378-44f9-b3e6-c0415117095e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:10.849962 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c9f64ec4-2378-44f9-b3e6-c0415117095e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:10.850601 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c9f64ec4-2378-44f9-b3e6-c0415117095e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:10.981297 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c9f64ec4-2378-44f9-b3e6-c0415117095e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:10.989762 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c9f64ec4-2378-44f9-b3e6-c0415117095e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1508 microversion: 2.1 time: 0.154710 Nov 02 07:34:10.990325 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 294/599] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:10 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:11.171387 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-fc6170fc-0666-4126-99b9-efae6f77838b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:11.171989 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-fc6170fc-0666-4126-99b9-efae6f77838b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:11.179306 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fc6170fc-0666-4126-99b9-efae6f77838b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:11.179781 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fc6170fc-0666-4126-99b9-efae6f77838b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:11.180206 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fc6170fc-0666-4126-99b9-efae6f77838b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:11.180878 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fc6170fc-0666-4126-99b9-efae6f77838b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:11.181319 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fc6170fc-0666-4126-99b9-efae6f77838b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:11.181730 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fc6170fc-0666-4126-99b9-efae6f77838b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:11.317197 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-fc6170fc-0666-4126-99b9-efae6f77838b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:11.325047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-fc6170fc-0666-4126-99b9-efae6f77838b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1265 microversion: 2.1 time: 0.157974 Nov 02 07:34:11.325604 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 306/600] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:11 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:12.014065 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-cb723ddb-5589-4347-852b-f4b73d68edfe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:12.014736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-cb723ddb-5589-4347-852b-f4b73d68edfe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:12.021242 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cb723ddb-5589-4347-852b-f4b73d68edfe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:12.021716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cb723ddb-5589-4347-852b-f4b73d68edfe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:12.022146 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cb723ddb-5589-4347-852b-f4b73d68edfe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:12.022896 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cb723ddb-5589-4347-852b-f4b73d68edfe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:12.023347 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cb723ddb-5589-4347-852b-f4b73d68edfe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:12.023766 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cb723ddb-5589-4347-852b-f4b73d68edfe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:12.154106 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-cb723ddb-5589-4347-852b-f4b73d68edfe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:12.162380 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-cb723ddb-5589-4347-852b-f4b73d68edfe tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1508 microversion: 2.1 time: 0.152160 Nov 02 07:34:12.163037 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 295/601] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:12 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:12.347375 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a2bbaf9e-a037-4664-a79e-22b30ebe1a3b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:12.348830 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a2bbaf9e-a037-4664-a79e-22b30ebe1a3b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:12.355254 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a2bbaf9e-a037-4664-a79e-22b30ebe1a3b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:12.355728 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a2bbaf9e-a037-4664-a79e-22b30ebe1a3b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:12.356157 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a2bbaf9e-a037-4664-a79e-22b30ebe1a3b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:12.357635 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a2bbaf9e-a037-4664-a79e-22b30ebe1a3b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:12.358312 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a2bbaf9e-a037-4664-a79e-22b30ebe1a3b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:12.358768 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a2bbaf9e-a037-4664-a79e-22b30ebe1a3b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:12.491425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a2bbaf9e-a037-4664-a79e-22b30ebe1a3b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:12.500081 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a2bbaf9e-a037-4664-a79e-22b30ebe1a3b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1265 microversion: 2.1 time: 0.156485 Nov 02 07:34:12.500902 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 307/602] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:12 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:34:13.185614 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-92a5a1fb-c089-4fec-ba61-a321d45c88cd tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:13.186219 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-92a5a1fb-c089-4fec-ba61-a321d45c88cd tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:13.192782 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-92a5a1fb-c089-4fec-ba61-a321d45c88cd tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:13.193258 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-92a5a1fb-c089-4fec-ba61-a321d45c88cd tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:13.193686 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-92a5a1fb-c089-4fec-ba61-a321d45c88cd tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:13.194384 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-92a5a1fb-c089-4fec-ba61-a321d45c88cd tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:13.194842 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-92a5a1fb-c089-4fec-ba61-a321d45c88cd tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:13.195258 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-92a5a1fb-c089-4fec-ba61-a321d45c88cd tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:13.323110 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-92a5a1fb-c089-4fec-ba61-a321d45c88cd tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:13.330953 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-92a5a1fb-c089-4fec-ba61-a321d45c88cd tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1508 microversion: 2.1 time: 0.149112 Nov 02 07:34:13.331668 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 296/603] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:13 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:13.396654 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-31c36faa-d768-4219-87ab-2ae441ae6480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:13.397193 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-31c36faa-d768-4219-87ab-2ae441ae6480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:13.403530 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-31c36faa-d768-4219-87ab-2ae441ae6480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:13.404006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-31c36faa-d768-4219-87ab-2ae441ae6480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:13.404431 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-31c36faa-d768-4219-87ab-2ae441ae6480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:13.405104 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-31c36faa-d768-4219-87ab-2ae441ae6480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:13.405545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-31c36faa-d768-4219-87ab-2ae441ae6480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:13.405957 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-31c36faa-d768-4219-87ab-2ae441ae6480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:13.428286 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.objects.instance [None req-31c36faa-d768-4219-87ab-2ae441ae6480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lazy-loading 'flavor' on Instance uuid 1e24f861-ba20-4595-9dd5-9ea1f9832284 {{(pid=118991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:34:13.456815 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:13.524431 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-da7d41f6-bd39-4bd8-b995-4203b14d5308 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:13.526073 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-da7d41f6-bd39-4bd8-b995-4203b14d5308 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:13.532596 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-da7d41f6-bd39-4bd8-b995-4203b14d5308 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:13.533235 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-da7d41f6-bd39-4bd8-b995-4203b14d5308 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:13.533766 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-da7d41f6-bd39-4bd8-b995-4203b14d5308 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:13.534583 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-da7d41f6-bd39-4bd8-b995-4203b14d5308 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:13.535197 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-da7d41f6-bd39-4bd8-b995-4203b14d5308 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:13.535731 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-da7d41f6-bd39-4bd8-b995-4203b14d5308 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:13.679394 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-da7d41f6-bd39-4bd8-b995-4203b14d5308 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:13.687598 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-da7d41f6-bd39-4bd8-b995-4203b14d5308 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1265 microversion: 2.1 time: 0.168437 Nov 02 07:34:13.688419 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 297/604] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:13 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:34:13.812479 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-31c36faa-d768-4219-87ab-2ae441ae6480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "POST /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284/action" status: 202 len: 0 microversion: 2.20 time: 0.420208 Nov 02 07:34:13.813069 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 308/605] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 07:34:13 2022] POST /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:34:13.822567 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a75b051c-a396-48d7-8a2f-391de60a4fd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:13.823511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a75b051c-a396-48d7-8a2f-391de60a4fd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:13.830189 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a75b051c-a396-48d7-8a2f-391de60a4fd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:13.830964 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a75b051c-a396-48d7-8a2f-391de60a4fd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:13.832778 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a75b051c-a396-48d7-8a2f-391de60a4fd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:13.833673 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a75b051c-a396-48d7-8a2f-391de60a4fd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:13.834138 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a75b051c-a396-48d7-8a2f-391de60a4fd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:13.834953 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a75b051c-a396-48d7-8a2f-391de60a4fd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:13.991649 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a75b051c-a396-48d7-8a2f-391de60a4fd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:14.001142 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a75b051c-a396-48d7-8a2f-391de60a4fd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:14.002811 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a75b051c-a396-48d7-8a2f-391de60a4fd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:14.004706 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a75b051c-a396-48d7-8a2f-391de60a4fd4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.186612 Nov 02 07:34:14.005712 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 298/606] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:13 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:14.153581 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-c2262686-4f23-4d12-bf54-895109904428 req-e9c9acc4-d5ce-4cf7-a1fd-61933dd41487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684b9aec-ddff-4c9c-9c18-957a432b3c17", "name": "network-vif-deleted", "tag": "3c1f0233-b78d-4abc-80ac-644aeafb4656"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:14.165619 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-c2262686-4f23-4d12-bf54-895109904428 req-e9c9acc4-d5ce-4cf7-a1fd-61933dd41487 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:14.166168 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-c2262686-4f23-4d12-bf54-895109904428 req-e9c9acc4-d5ce-4cf7-a1fd-61933dd41487 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:14.166695 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-c2262686-4f23-4d12-bf54-895109904428 req-e9c9acc4-d5ce-4cf7-a1fd-61933dd41487 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:14.178285 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-c2262686-4f23-4d12-bf54-895109904428 req-e9c9acc4-d5ce-4cf7-a1fd-61933dd41487 service nova] Creating event network-vif-deleted:3c1f0233-b78d-4abc-80ac-644aeafb4656 for instance 684b9aec-ddff-4c9c-9c18-957a432b3c17 on hv-cinder-80473 Nov 02 07:34:14.183792 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-c2262686-4f23-4d12-bf54-895109904428 req-e9c9acc4-d5ce-4cf7-a1fd-61933dd41487 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034249 Nov 02 07:34:14.185038 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 309/607] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:34:14.200906 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-67ee210d-08f2-4cf6-87dd-18cb89a421f2 req-86ef1a4c-5aba-4f84-a4f1-9128cb37da99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b63e70e7-b2ef-4b6e-9457-7f92d1adc30b", "name": "network-vif-plugged", "status": "completed", "tag": "5170ac1a-792e-408b-9e77-31d91e95efd5"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:14.212613 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-67ee210d-08f2-4cf6-87dd-18cb89a421f2 req-86ef1a4c-5aba-4f84-a4f1-9128cb37da99 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:14.213101 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-67ee210d-08f2-4cf6-87dd-18cb89a421f2 req-86ef1a4c-5aba-4f84-a4f1-9128cb37da99 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:14.213530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-67ee210d-08f2-4cf6-87dd-18cb89a421f2 req-86ef1a4c-5aba-4f84-a4f1-9128cb37da99 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:14.230010 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-67ee210d-08f2-4cf6-87dd-18cb89a421f2 req-86ef1a4c-5aba-4f84-a4f1-9128cb37da99 service nova] Creating event network-vif-plugged:5170ac1a-792e-408b-9e77-31d91e95efd5 for instance b63e70e7-b2ef-4b6e-9457-7f92d1adc30b on hv-cinder-80473 Nov 02 07:34:14.235988 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-67ee210d-08f2-4cf6-87dd-18cb89a421f2 req-86ef1a4c-5aba-4f84-a4f1-9128cb37da99 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038861 Nov 02 07:34:14.236585 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 299/608] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:34:14.355399 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-e050c367-3a12-423e-af0a-f28009b6f6e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:14.356218 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-e050c367-3a12-423e-af0a-f28009b6f6e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:14.370209 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e050c367-3a12-423e-af0a-f28009b6f6e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:14.371042 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e050c367-3a12-423e-af0a-f28009b6f6e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:14.371698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e050c367-3a12-423e-af0a-f28009b6f6e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:14.372747 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e050c367-3a12-423e-af0a-f28009b6f6e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:14.373436 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e050c367-3a12-423e-af0a-f28009b6f6e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:14.373876 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e050c367-3a12-423e-af0a-f28009b6f6e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:14.412471 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e050c367-3a12-423e-af0a-f28009b6f6e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:14.413079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e050c367-3a12-423e-af0a-f28009b6f6e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:14.413389 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e050c367-3a12-423e-af0a-f28009b6f6e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:14.413817 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.objects.instance [None req-e050c367-3a12-423e-af0a-f28009b6f6e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lazy-loading 'fault' on Instance uuid 684b9aec-ddff-4c9c-9c18-957a432b3c17 {{(pid=118991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:34:14.455502 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e050c367-3a12-423e-af0a-f28009b6f6e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:14.464049 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e050c367-3a12-423e-af0a-f28009b6f6e5 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1312 microversion: 2.1 time: 0.112705 Nov 02 07:34:14.464615 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 310/609] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:14 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:34:14.710988 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c0cc10bf-4bb9-4b3d-83ef-6414771ad5d5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:14.711691 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c0cc10bf-4bb9-4b3d-83ef-6414771ad5d5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:14.717964 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c0cc10bf-4bb9-4b3d-83ef-6414771ad5d5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:14.718475 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c0cc10bf-4bb9-4b3d-83ef-6414771ad5d5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:14.718912 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c0cc10bf-4bb9-4b3d-83ef-6414771ad5d5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:14.719667 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c0cc10bf-4bb9-4b3d-83ef-6414771ad5d5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:14.720115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c0cc10bf-4bb9-4b3d-83ef-6414771ad5d5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:14.720533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c0cc10bf-4bb9-4b3d-83ef-6414771ad5d5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:14.857073 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c0cc10bf-4bb9-4b3d-83ef-6414771ad5d5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:14.860816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:14.867267 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c0cc10bf-4bb9-4b3d-83ef-6414771ad5d5 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1265 microversion: 2.1 time: 0.161225 Nov 02 07:34:14.867848 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 300/610] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:14 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:15.030735 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-98026bca-0a8a-4448-9861-7c69bd1fade1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:15.031358 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-98026bca-0a8a-4448-9861-7c69bd1fade1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:15.037800 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98026bca-0a8a-4448-9861-7c69bd1fade1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:15.038277 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98026bca-0a8a-4448-9861-7c69bd1fade1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:15.038729 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98026bca-0a8a-4448-9861-7c69bd1fade1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:15.039401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98026bca-0a8a-4448-9861-7c69bd1fade1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:15.039843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98026bca-0a8a-4448-9861-7c69bd1fade1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:15.040256 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98026bca-0a8a-4448-9861-7c69bd1fade1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:15.167195 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-98026bca-0a8a-4448-9861-7c69bd1fade1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:15.175617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-98026bca-0a8a-4448-9861-7c69bd1fade1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:15.177775 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-98026bca-0a8a-4448-9861-7c69bd1fade1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:15.178972 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-98026bca-0a8a-4448-9861-7c69bd1fade1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.152292 Nov 02 07:34:15.179541 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 311/611] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:15 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:15.487163 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1e94cf26-7f18-48b2-bc7e-e622f8f73930 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:15.487711 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1e94cf26-7f18-48b2-bc7e-e622f8f73930 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:15.496270 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e94cf26-7f18-48b2-bc7e-e622f8f73930 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:15.496750 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e94cf26-7f18-48b2-bc7e-e622f8f73930 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:15.497182 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e94cf26-7f18-48b2-bc7e-e622f8f73930 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:15.497896 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e94cf26-7f18-48b2-bc7e-e622f8f73930 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:15.498351 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e94cf26-7f18-48b2-bc7e-e622f8f73930 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:15.498791 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e94cf26-7f18-48b2-bc7e-e622f8f73930 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:15.529504 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e94cf26-7f18-48b2-bc7e-e622f8f73930 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:15.529969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e94cf26-7f18-48b2-bc7e-e622f8f73930 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:15.530423 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1e94cf26-7f18-48b2-bc7e-e622f8f73930 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:15.530862 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-1e94cf26-7f18-48b2-bc7e-e622f8f73930 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lazy-loading 'fault' on Instance uuid 684b9aec-ddff-4c9c-9c18-957a432b3c17 {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:34:15.677833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1e94cf26-7f18-48b2-bc7e-e622f8f73930 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:15.684761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-1e94cf26-7f18-48b2-bc7e-e622f8f73930 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 200 len: 1312 microversion: 2.1 time: 0.201517 Nov 02 07:34:15.685311 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 301/612] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:15 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 1312 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:15.890741 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0c99e74e-5391-47e4-a88e-deb3433770b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:15.891357 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-0c99e74e-5391-47e4-a88e-deb3433770b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:15.898695 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0c99e74e-5391-47e4-a88e-deb3433770b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:15.899181 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0c99e74e-5391-47e4-a88e-deb3433770b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:15.899633 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0c99e74e-5391-47e4-a88e-deb3433770b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:15.900306 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0c99e74e-5391-47e4-a88e-deb3433770b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:15.900762 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0c99e74e-5391-47e4-a88e-deb3433770b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:15.901186 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0c99e74e-5391-47e4-a88e-deb3433770b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:16.036308 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0c99e74e-5391-47e4-a88e-deb3433770b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:16.043916 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0c99e74e-5391-47e4-a88e-deb3433770b2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1265 microversion: 2.1 time: 0.157063 Nov 02 07:34:16.044478 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 312/613] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:15 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:16.204055 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a2aee44c-e52a-4d99-b16c-179ab57d435a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:16.204577 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a2aee44c-e52a-4d99-b16c-179ab57d435a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:16.211170 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a2aee44c-e52a-4d99-b16c-179ab57d435a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:16.211647 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a2aee44c-e52a-4d99-b16c-179ab57d435a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:16.212078 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a2aee44c-e52a-4d99-b16c-179ab57d435a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:16.212756 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a2aee44c-e52a-4d99-b16c-179ab57d435a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:16.213202 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a2aee44c-e52a-4d99-b16c-179ab57d435a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:16.213619 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a2aee44c-e52a-4d99-b16c-179ab57d435a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:16.346598 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a2aee44c-e52a-4d99-b16c-179ab57d435a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:16.355612 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a2aee44c-e52a-4d99-b16c-179ab57d435a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:16.357050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a2aee44c-e52a-4d99-b16c-179ab57d435a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:16.358244 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a2aee44c-e52a-4d99-b16c-179ab57d435a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.158209 Nov 02 07:34:16.358819 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 302/614] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:16 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:34:16.708302 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-958f5522-0709-45ae-a657-10578587c130 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:16.708937 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-958f5522-0709-45ae-a657-10578587c130 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 684b9aec-ddff-4c9c-9c18-957a432b3c17] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:16.714982 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-958f5522-0709-45ae-a657-10578587c130 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:16.715459 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-958f5522-0709-45ae-a657-10578587c130 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:16.715913 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-958f5522-0709-45ae-a657-10578587c130 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:16.716593 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-958f5522-0709-45ae-a657-10578587c130 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:16.717040 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-958f5522-0709-45ae-a657-10578587c130 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:16.717458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-958f5522-0709-45ae-a657-10578587c130 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:16.730880 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-958f5522-0709-45ae-a657-10578587c130 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] HTTP exception thrown: Instance 684b9aec-ddff-4c9c-9c18-957a432b3c17 could not be found. Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-958f5522-0709-45ae-a657-10578587c130 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Request method failure captured: Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 HTTP/1.1 Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhxUEtNtZTs4ic7TO1YHq64wZsN5qBfs97ESDbbUSAfzzoKKF4aWoMtTWeaBh0tZLpMPcjYYxG24mgb4lumO_vWqHxQoVjCNp3JVn1PYMG7yUkIv-CwxwRq4pRuWrgDLhanWDwQK429gy3U8ZyWDQ8-vGuKkNzeaxCqAyS8AZk8aIVo Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: c60cb95cbf734d9b852af2bdcad4e1c0 Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-276708690 Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:34:16.732579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:34:16.734153 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c60cb95cbf734d9b852af2bdcad4e1c0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c60cb95cbf734d9b852af2bdcad4e1c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c60cb95cbf734d9b852af2bdcad4e1c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c60cb95cbf734d9b852af2bdcad4e1c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:34:16.734153 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-ServerRescueNegativeTestJSON-276708690 Nov 02 07:34:16.734153 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: c60cb95cbf734d9b852af2bdcad4e1c0 Nov 02 07:34:16.734153 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-276708690 Nov 02 07:34:16.734153 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-ServerRescueNegativeTestJSON-276708690-project Nov 02 07:34:16.734153 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:34:16.734153 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:34:16.734153 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 0e571b0f4d6f4fafb71939f501b8deec Nov 02 07:34:16.734153 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-ServerRescueNegativeTestJSON-276708690-project Nov 02 07:34:16.734153 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:34:16.734153 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance 684b9aec-ddff-4c9c-9c18-957a432b3c17 could not be found. Nov 02 07:34:16.734153 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': '684b9aec-ddff-4c9c-9c18-957a432b3c17'} Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 684b9aec-ddff-4c9c-9c18-957a432b3c17 could not be found. Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:34:16.734999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 684b9aec-ddff-4c9c-9c18-957a432b3c17 could not be found. Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 684b9aec-ddff-4c9c-9c18-957a432b3c17 could not be found. Nov 02 07:34:16.736207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:34:16.737418 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-958f5522-0709-45ae-a657-10578587c130 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Returning 404 to user: Instance 684b9aec-ddff-4c9c-9c18-957a432b3c17 could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:34:16.737418 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-958f5522-0709-45ae-a657-10578587c130 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17" status: 404 len: 111 microversion: 2.1 time: 0.030183 Nov 02 07:34:16.737418 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 313/615] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:16 2022] GET /compute/v2.1/servers/684b9aec-ddff-4c9c-9c18-957a432b3c17 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:34:16.742865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7794d25d-bc0e-4876-86e1-5bdc5cb12778 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:16.743360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-7794d25d-bc0e-4876-86e1-5bdc5cb12778 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:16.749705 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7794d25d-bc0e-4876-86e1-5bdc5cb12778 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:16.750174 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7794d25d-bc0e-4876-86e1-5bdc5cb12778 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:16.750630 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7794d25d-bc0e-4876-86e1-5bdc5cb12778 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:16.751581 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7794d25d-bc0e-4876-86e1-5bdc5cb12778 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:16.752031 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7794d25d-bc0e-4876-86e1-5bdc5cb12778 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:16.752445 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7794d25d-bc0e-4876-86e1-5bdc5cb12778 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:16.777875 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-7794d25d-bc0e-4876-86e1-5bdc5cb12778 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Going to try to terminate instance {{(pid=118992) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:34:16.850983 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-7794d25d-bc0e-4876-86e1-5bdc5cb12778 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "DELETE /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 204 len: 0 microversion: 2.1 time: 0.111885 Nov 02 07:34:16.851574 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 303/616] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:34:16 2022] DELETE /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 07:34:16.859830 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-df7931aa-50d0-4f43-8d46-e720067df562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:16.860450 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-df7931aa-50d0-4f43-8d46-e720067df562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:16.867095 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df7931aa-50d0-4f43-8d46-e720067df562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:16.867576 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df7931aa-50d0-4f43-8d46-e720067df562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:16.868031 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df7931aa-50d0-4f43-8d46-e720067df562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:16.868714 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df7931aa-50d0-4f43-8d46-e720067df562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:16.869162 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df7931aa-50d0-4f43-8d46-e720067df562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:16.869625 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-df7931aa-50d0-4f43-8d46-e720067df562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:17.002342 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-df7931aa-50d0-4f43-8d46-e720067df562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:17.010651 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-df7931aa-50d0-4f43-8d46-e720067df562 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.154694 Nov 02 07:34:17.011215 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 314/617] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:16 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:17.067734 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-75b20eaf-e976-4aaa-b1bf-86e9435e54c7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:17.068440 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-75b20eaf-e976-4aaa-b1bf-86e9435e54c7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:17.074328 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75b20eaf-e976-4aaa-b1bf-86e9435e54c7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:17.074845 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75b20eaf-e976-4aaa-b1bf-86e9435e54c7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:17.075283 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75b20eaf-e976-4aaa-b1bf-86e9435e54c7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:17.075976 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75b20eaf-e976-4aaa-b1bf-86e9435e54c7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:17.076430 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75b20eaf-e976-4aaa-b1bf-86e9435e54c7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:17.076853 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75b20eaf-e976-4aaa-b1bf-86e9435e54c7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:17.206298 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-75b20eaf-e976-4aaa-b1bf-86e9435e54c7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:17.217594 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-75b20eaf-e976-4aaa-b1bf-86e9435e54c7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1452 microversion: 2.1 time: 0.155344 Nov 02 07:34:17.218166 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 304/618] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:17 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:17.243066 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-159d3066-cbe7-44bb-aed3-f6725dc55ef4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:17.243674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-159d3066-cbe7-44bb-aed3-f6725dc55ef4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:17.249550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-159d3066-cbe7-44bb-aed3-f6725dc55ef4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:17.250028 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-159d3066-cbe7-44bb-aed3-f6725dc55ef4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:17.250488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-159d3066-cbe7-44bb-aed3-f6725dc55ef4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:17.251436 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-159d3066-cbe7-44bb-aed3-f6725dc55ef4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:17.251883 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-159d3066-cbe7-44bb-aed3-f6725dc55ef4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:17.252306 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-159d3066-cbe7-44bb-aed3-f6725dc55ef4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:17.380599 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-159d3066-cbe7-44bb-aed3-f6725dc55ef4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:17.383480 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3a88de68-b1fc-4cfd-a7a3-a7f198580c8e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:17.384097 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3a88de68-b1fc-4cfd-a7a3-a7f198580c8e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:17.388690 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-159d3066-cbe7-44bb-aed3-f6725dc55ef4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1452 microversion: 2.1 time: 0.150035 Nov 02 07:34:17.389257 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 315/619] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:17 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:17.390055 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3a88de68-b1fc-4cfd-a7a3-a7f198580c8e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:17.390579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3a88de68-b1fc-4cfd-a7a3-a7f198580c8e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:17.391012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3a88de68-b1fc-4cfd-a7a3-a7f198580c8e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:17.391734 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3a88de68-b1fc-4cfd-a7a3-a7f198580c8e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:17.392205 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3a88de68-b1fc-4cfd-a7a3-a7f198580c8e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:17.392607 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3a88de68-b1fc-4cfd-a7a3-a7f198580c8e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:17.527156 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3a88de68-b1fc-4cfd-a7a3-a7f198580c8e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:17.536154 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3a88de68-b1fc-4cfd-a7a3-a7f198580c8e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:17.537627 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3a88de68-b1fc-4cfd-a7a3-a7f198580c8e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:17.538807 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3a88de68-b1fc-4cfd-a7a3-a7f198580c8e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.159404 Nov 02 07:34:17.539350 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 305/620] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:17 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:34:18.034309 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-976bd9c7-2816-4c98-946d-f7397f8d100e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:18.035049 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-976bd9c7-2816-4c98-946d-f7397f8d100e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:18.041862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-976bd9c7-2816-4c98-946d-f7397f8d100e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:18.042350 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-976bd9c7-2816-4c98-946d-f7397f8d100e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:18.042813 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-976bd9c7-2816-4c98-946d-f7397f8d100e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:18.043520 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-976bd9c7-2816-4c98-946d-f7397f8d100e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:18.043971 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-976bd9c7-2816-4c98-946d-f7397f8d100e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:18.044393 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-976bd9c7-2816-4c98-946d-f7397f8d100e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:18.179634 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-976bd9c7-2816-4c98-946d-f7397f8d100e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:18.187806 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-976bd9c7-2816-4c98-946d-f7397f8d100e tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.157432 Nov 02 07:34:18.188457 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 316/621] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:18 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:18.563941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-96b4c22d-719b-474e-b5db-b013a7c2b80b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:18.564548 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-96b4c22d-719b-474e-b5db-b013a7c2b80b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:18.571847 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-96b4c22d-719b-474e-b5db-b013a7c2b80b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:18.572323 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-96b4c22d-719b-474e-b5db-b013a7c2b80b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:18.572747 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-96b4c22d-719b-474e-b5db-b013a7c2b80b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:18.573432 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-96b4c22d-719b-474e-b5db-b013a7c2b80b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:18.573874 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-96b4c22d-719b-474e-b5db-b013a7c2b80b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:18.574286 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-96b4c22d-719b-474e-b5db-b013a7c2b80b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:18.707968 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-96b4c22d-719b-474e-b5db-b013a7c2b80b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:18.717233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-96b4c22d-719b-474e-b5db-b013a7c2b80b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:18.718716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-96b4c22d-719b-474e-b5db-b013a7c2b80b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:18.719874 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-96b4c22d-719b-474e-b5db-b013a7c2b80b tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.159809 Nov 02 07:34:18.720435 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 306/622] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:18 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:18.977462 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-e89c26c4-e7cc-4707-8761-72b7eef6dc80 req-7561e462-c96f-4bac-860d-61e03e4dd24a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b63e70e7-b2ef-4b6e-9457-7f92d1adc30b", "tag": "5170ac1a-792e-408b-9e77-31d91e95efd5"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:18.986760 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-e89c26c4-e7cc-4707-8761-72b7eef6dc80 req-7561e462-c96f-4bac-860d-61e03e4dd24a service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:18.987306 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-e89c26c4-e7cc-4707-8761-72b7eef6dc80 req-7561e462-c96f-4bac-860d-61e03e4dd24a service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:18.987820 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-e89c26c4-e7cc-4707-8761-72b7eef6dc80 req-7561e462-c96f-4bac-860d-61e03e4dd24a service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:19.000045 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-e89c26c4-e7cc-4707-8761-72b7eef6dc80 req-7561e462-c96f-4bac-860d-61e03e4dd24a service nova] Creating event network-changed:5170ac1a-792e-408b-9e77-31d91e95efd5 for instance b63e70e7-b2ef-4b6e-9457-7f92d1adc30b on hv-cinder-80473 Nov 02 07:34:19.005869 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-e89c26c4-e7cc-4707-8761-72b7eef6dc80 req-7561e462-c96f-4bac-860d-61e03e4dd24a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032044 Nov 02 07:34:19.006483 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 317/623] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:34:19.212132 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-409bae3c-9582-4214-9c42-e177734ac561 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:19.212745 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-409bae3c-9582-4214-9c42-e177734ac561 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:19.218706 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-409bae3c-9582-4214-9c42-e177734ac561 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:19.219190 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-409bae3c-9582-4214-9c42-e177734ac561 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:19.219624 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-409bae3c-9582-4214-9c42-e177734ac561 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:19.220320 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-409bae3c-9582-4214-9c42-e177734ac561 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:19.220780 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-409bae3c-9582-4214-9c42-e177734ac561 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:19.221204 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-409bae3c-9582-4214-9c42-e177734ac561 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:19.350802 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-409bae3c-9582-4214-9c42-e177734ac561 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:19.358613 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-409bae3c-9582-4214-9c42-e177734ac561 tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.150503 Nov 02 07:34:19.359172 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 307/624] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:19 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:34:19.746782 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d5fe660e-fb36-41dc-8aa8-a04bd717639a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:19.747482 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-d5fe660e-fb36-41dc-8aa8-a04bd717639a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:19.754094 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d5fe660e-fb36-41dc-8aa8-a04bd717639a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:19.754612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d5fe660e-fb36-41dc-8aa8-a04bd717639a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:19.755053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d5fe660e-fb36-41dc-8aa8-a04bd717639a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:19.755764 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d5fe660e-fb36-41dc-8aa8-a04bd717639a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:19.756218 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d5fe660e-fb36-41dc-8aa8-a04bd717639a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:19.756649 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d5fe660e-fb36-41dc-8aa8-a04bd717639a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:19.896086 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d5fe660e-fb36-41dc-8aa8-a04bd717639a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:19.927831 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d5fe660e-fb36-41dc-8aa8-a04bd717639a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:19.930715 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d5fe660e-fb36-41dc-8aa8-a04bd717639a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:19.931970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d5fe660e-fb36-41dc-8aa8-a04bd717639a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.190035 Nov 02 07:34:19.932787 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 318/625] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:19 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:20.381527 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-5e8f39dd-11bf-4e0e-8369-821cd4c01dac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:20.382297 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-5e8f39dd-11bf-4e0e-8369-821cd4c01dac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:20.389043 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5e8f39dd-11bf-4e0e-8369-821cd4c01dac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:20.389549 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5e8f39dd-11bf-4e0e-8369-821cd4c01dac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:20.389965 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5e8f39dd-11bf-4e0e-8369-821cd4c01dac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:20.390690 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5e8f39dd-11bf-4e0e-8369-821cd4c01dac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:20.391279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5e8f39dd-11bf-4e0e-8369-821cd4c01dac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:20.391706 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5e8f39dd-11bf-4e0e-8369-821cd4c01dac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:20.609180 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-5e8f39dd-11bf-4e0e-8369-821cd4c01dac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e571b0f4d6f4fafb71939f501b8deec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60cb95cbf734d9b852af2bdcad4e1c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:20.617032 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-5e8f39dd-11bf-4e0e-8369-821cd4c01dac tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 200 len: 1522 microversion: 2.1 time: 0.239512 Nov 02 07:34:20.617692 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 308/626] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:20 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:20.771817 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-fd69e81d-64f6-4ec4-9537-5a3500ccf9b9 req-bfb0ed11-22e1-47d9-b8ae-41c6bbd09d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983e9075-27cf-4c74-bf6b-ff9fe8a68018", "name": "network-vif-deleted", "tag": "0ee6dd20-0770-4e10-ac8f-d0e34d519f81"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:20.781773 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-fd69e81d-64f6-4ec4-9537-5a3500ccf9b9 req-bfb0ed11-22e1-47d9-b8ae-41c6bbd09d05 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:20.782243 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-fd69e81d-64f6-4ec4-9537-5a3500ccf9b9 req-bfb0ed11-22e1-47d9-b8ae-41c6bbd09d05 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:20.782714 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-fd69e81d-64f6-4ec4-9537-5a3500ccf9b9 req-bfb0ed11-22e1-47d9-b8ae-41c6bbd09d05 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:20.794662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-fd69e81d-64f6-4ec4-9537-5a3500ccf9b9 req-bfb0ed11-22e1-47d9-b8ae-41c6bbd09d05 service nova] Creating event network-vif-deleted:0ee6dd20-0770-4e10-ac8f-d0e34d519f81 for instance 983e9075-27cf-4c74-bf6b-ff9fe8a68018 on hv-cinder-80473 Nov 02 07:34:20.799523 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-fd69e81d-64f6-4ec4-9537-5a3500ccf9b9 req-bfb0ed11-22e1-47d9-b8ae-41c6bbd09d05 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031757 Nov 02 07:34:20.800320 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 319/627] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:34:20.958756 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f743bfab-e50f-4408-80e5-2366c0f32148 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:20.959524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f743bfab-e50f-4408-80e5-2366c0f32148 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:20.966386 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f743bfab-e50f-4408-80e5-2366c0f32148 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:20.966999 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f743bfab-e50f-4408-80e5-2366c0f32148 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:20.967589 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f743bfab-e50f-4408-80e5-2366c0f32148 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:20.968478 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f743bfab-e50f-4408-80e5-2366c0f32148 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:20.969033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f743bfab-e50f-4408-80e5-2366c0f32148 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:20.969552 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f743bfab-e50f-4408-80e5-2366c0f32148 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:21.112807 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f743bfab-e50f-4408-80e5-2366c0f32148 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:21.122197 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f743bfab-e50f-4408-80e5-2366c0f32148 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:21.124000 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f743bfab-e50f-4408-80e5-2366c0f32148 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:21.126344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f743bfab-e50f-4408-80e5-2366c0f32148 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.172101 Nov 02 07:34:21.127900 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 309/628] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:20 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:21.641392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b85064a5-cf96-42b7-b744-a21b62bbd18b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:21.641992 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b85064a5-cf96-42b7-b744-a21b62bbd18b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] [instance: 983e9075-27cf-4c74-bf6b-ff9fe8a68018] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:21.648797 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b85064a5-cf96-42b7-b744-a21b62bbd18b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:21.649272 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b85064a5-cf96-42b7-b744-a21b62bbd18b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:21.649698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b85064a5-cf96-42b7-b744-a21b62bbd18b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:21.650405 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b85064a5-cf96-42b7-b744-a21b62bbd18b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:21.650852 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b85064a5-cf96-42b7-b744-a21b62bbd18b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:21.651267 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b85064a5-cf96-42b7-b744-a21b62bbd18b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:21.664989 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-b85064a5-cf96-42b7-b744-a21b62bbd18b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] HTTP exception thrown: Instance 983e9075-27cf-4c74-bf6b-ff9fe8a68018 could not be found. Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b85064a5-cf96-42b7-b744-a21b62bbd18b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Request method failure captured: Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 HTTP/1.1 Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhxUEtNtZTs4ic7TO1YHq64wZsN5qBfs97ESDbbUSAfzzoKKF4aWoMtTWeaBh0tZLpMPcjYYxG24mgb4lumO_vWqHxQoVjCNp3JVn1PYMG7yUkIv-CwxwRq4pRuWrgDLhanWDwQK429gy3U8ZyWDQ8-vGuKkNzeaxCqAyS8AZk8aIVo Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: c60cb95cbf734d9b852af2bdcad4e1c0 Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-276708690 Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:34:21.666617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:34:21.668139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c60cb95cbf734d9b852af2bdcad4e1c0", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c60cb95cbf734d9b852af2bdcad4e1c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c60cb95cbf734d9b852af2bdcad4e1c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c60cb95cbf734d9b852af2bdcad4e1c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:34:21.668139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-ServerRescueNegativeTestJSON-276708690 Nov 02 07:34:21.668139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: c60cb95cbf734d9b852af2bdcad4e1c0 Nov 02 07:34:21.668139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-276708690 Nov 02 07:34:21.668139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-ServerRescueNegativeTestJSON-276708690-project Nov 02 07:34:21.668139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:34:21.668139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:34:21.668139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 0e571b0f4d6f4fafb71939f501b8deec Nov 02 07:34:21.668139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-ServerRescueNegativeTestJSON-276708690-project Nov 02 07:34:21.668139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:34:21.668139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance 983e9075-27cf-4c74-bf6b-ff9fe8a68018 could not be found. Nov 02 07:34:21.668139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': '983e9075-27cf-4c74-bf6b-ff9fe8a68018'} Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 983e9075-27cf-4c74-bf6b-ff9fe8a68018 could not be found. Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:34:21.669005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 983e9075-27cf-4c74-bf6b-ff9fe8a68018 could not be found. Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 983e9075-27cf-4c74-bf6b-ff9fe8a68018 could not be found. Nov 02 07:34:21.670430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:34:21.671666 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b85064a5-cf96-42b7-b744-a21b62bbd18b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] Returning 404 to user: Instance 983e9075-27cf-4c74-bf6b-ff9fe8a68018 could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:34:21.671666 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b85064a5-cf96-42b7-b744-a21b62bbd18b tempest-ServerRescueNegativeTestJSON-276708690 tempest-ServerRescueNegativeTestJSON-276708690-project] 10.222.0.18 "GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018" status: 404 len: 111 microversion: 2.1 time: 0.030979 Nov 02 07:34:21.671666 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 320/629] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:21 2022] GET /compute/v2.1/servers/983e9075-27cf-4c74-bf6b-ff9fe8a68018 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:34:22.154629 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-818661cf-a104-44c4-b229-2566145aa2e1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:22.155162 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-818661cf-a104-44c4-b229-2566145aa2e1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:22.161501 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-818661cf-a104-44c4-b229-2566145aa2e1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:22.162735 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-818661cf-a104-44c4-b229-2566145aa2e1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:22.163662 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-818661cf-a104-44c4-b229-2566145aa2e1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:22.164368 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-818661cf-a104-44c4-b229-2566145aa2e1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:22.164829 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-818661cf-a104-44c4-b229-2566145aa2e1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:22.165257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-818661cf-a104-44c4-b229-2566145aa2e1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:22.301008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-818661cf-a104-44c4-b229-2566145aa2e1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:22.310569 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-818661cf-a104-44c4-b229-2566145aa2e1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:22.312124 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-818661cf-a104-44c4-b229-2566145aa2e1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:22.313386 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-818661cf-a104-44c4-b229-2566145aa2e1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.162905 Nov 02 07:34:22.314035 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 310/630] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:22 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:23.340327 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a3669098-8c3b-4afe-820a-26800b9afa88 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:23.341280 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a3669098-8c3b-4afe-820a-26800b9afa88 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:23.348357 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a3669098-8c3b-4afe-820a-26800b9afa88 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:23.349091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a3669098-8c3b-4afe-820a-26800b9afa88 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:23.349732 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a3669098-8c3b-4afe-820a-26800b9afa88 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:23.350681 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a3669098-8c3b-4afe-820a-26800b9afa88 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:23.351443 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a3669098-8c3b-4afe-820a-26800b9afa88 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:23.351865 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a3669098-8c3b-4afe-820a-26800b9afa88 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:23.586059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a3669098-8c3b-4afe-820a-26800b9afa88 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:23.596852 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a3669098-8c3b-4afe-820a-26800b9afa88 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:23.598845 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a3669098-8c3b-4afe-820a-26800b9afa88 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:23.601393 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a3669098-8c3b-4afe-820a-26800b9afa88 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.264944 Nov 02 07:34:23.601953 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 321/631] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:23 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:24.626776 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-8fd90f6a-d9c8-4c9f-bf45-5424060e1e3a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:24.627381 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-8fd90f6a-d9c8-4c9f-bf45-5424060e1e3a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:24.629827 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:24.635279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8fd90f6a-d9c8-4c9f-bf45-5424060e1e3a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:24.635766 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8fd90f6a-d9c8-4c9f-bf45-5424060e1e3a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:24.636191 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8fd90f6a-d9c8-4c9f-bf45-5424060e1e3a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:24.636877 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8fd90f6a-d9c8-4c9f-bf45-5424060e1e3a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:24.637322 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8fd90f6a-d9c8-4c9f-bf45-5424060e1e3a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:24.637740 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8fd90f6a-d9c8-4c9f-bf45-5424060e1e3a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:24.867273 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-8fd90f6a-d9c8-4c9f-bf45-5424060e1e3a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:24.878493 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-8fd90f6a-d9c8-4c9f-bf45-5424060e1e3a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:24.881264 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-8fd90f6a-d9c8-4c9f-bf45-5424060e1e3a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:24.882734 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-8fd90f6a-d9c8-4c9f-bf45-5424060e1e3a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.260203 Nov 02 07:34:24.894877 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 311/632] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:24 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:25.917236 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-81af3f55-2479-4c1b-9840-f64ec8b77f12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:25.918606 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-81af3f55-2479-4c1b-9840-f64ec8b77f12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:25.930645 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-81af3f55-2479-4c1b-9840-f64ec8b77f12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:25.931444 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-81af3f55-2479-4c1b-9840-f64ec8b77f12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:25.932636 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-81af3f55-2479-4c1b-9840-f64ec8b77f12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:25.934124 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-81af3f55-2479-4c1b-9840-f64ec8b77f12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:25.935303 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-81af3f55-2479-4c1b-9840-f64ec8b77f12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:25.935914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-81af3f55-2479-4c1b-9840-f64ec8b77f12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:26.158403 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-81af3f55-2479-4c1b-9840-f64ec8b77f12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:26.167814 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-81af3f55-2479-4c1b-9840-f64ec8b77f12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:26.169304 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-81af3f55-2479-4c1b-9840-f64ec8b77f12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:26.170529 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-81af3f55-2479-4c1b-9840-f64ec8b77f12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.259944 Nov 02 07:34:26.171068 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 322/633] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:25 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:27.377080 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-20a378bd-92a5-462b-9174-0726ef042ae2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:27.377768 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-20a378bd-92a5-462b-9174-0726ef042ae2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:27.384206 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-20a378bd-92a5-462b-9174-0726ef042ae2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:27.384632 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-20a378bd-92a5-462b-9174-0726ef042ae2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:27.385159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-20a378bd-92a5-462b-9174-0726ef042ae2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:27.385748 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-20a378bd-92a5-462b-9174-0726ef042ae2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:27.386270 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-20a378bd-92a5-462b-9174-0726ef042ae2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:27.386647 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-20a378bd-92a5-462b-9174-0726ef042ae2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:27.526339 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-20a378bd-92a5-462b-9174-0726ef042ae2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:27.534533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-20a378bd-92a5-462b-9174-0726ef042ae2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:27.536000 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-20a378bd-92a5-462b-9174-0726ef042ae2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:27.537258 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-20a378bd-92a5-462b-9174-0726ef042ae2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.344210 Nov 02 07:34:27.537823 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 312/634] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:27 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:28.562735 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c05f8e4d-bc1a-4bf3-8f38-e360f566bf65 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:28.563377 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c05f8e4d-bc1a-4bf3-8f38-e360f566bf65 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:28.570558 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c05f8e4d-bc1a-4bf3-8f38-e360f566bf65 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:28.571042 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c05f8e4d-bc1a-4bf3-8f38-e360f566bf65 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:28.571476 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c05f8e4d-bc1a-4bf3-8f38-e360f566bf65 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:28.572169 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c05f8e4d-bc1a-4bf3-8f38-e360f566bf65 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:28.572617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c05f8e4d-bc1a-4bf3-8f38-e360f566bf65 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:28.573037 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c05f8e4d-bc1a-4bf3-8f38-e360f566bf65 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:28.707485 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c05f8e4d-bc1a-4bf3-8f38-e360f566bf65 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:28.718113 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c05f8e4d-bc1a-4bf3-8f38-e360f566bf65 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:28.719597 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c05f8e4d-bc1a-4bf3-8f38-e360f566bf65 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:28.720969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c05f8e4d-bc1a-4bf3-8f38-e360f566bf65 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.162041 Nov 02 07:34:28.721703 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 323/635] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:28 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:29.746618 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-54065131-9291-4335-8b71-7a72110f92ba tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:29.747227 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-54065131-9291-4335-8b71-7a72110f92ba tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:29.754068 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-54065131-9291-4335-8b71-7a72110f92ba tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:29.754590 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-54065131-9291-4335-8b71-7a72110f92ba tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:29.755023 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-54065131-9291-4335-8b71-7a72110f92ba tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:29.755706 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-54065131-9291-4335-8b71-7a72110f92ba tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:29.756895 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-54065131-9291-4335-8b71-7a72110f92ba tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:29.757320 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-54065131-9291-4335-8b71-7a72110f92ba tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:29.891364 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-54065131-9291-4335-8b71-7a72110f92ba tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:29.899451 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-54065131-9291-4335-8b71-7a72110f92ba tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:29.900823 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-54065131-9291-4335-8b71-7a72110f92ba tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:29.901981 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-54065131-9291-4335-8b71-7a72110f92ba tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.159291 Nov 02 07:34:29.902583 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 313/636] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:29 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:30.929321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-e5ce9691-3747-481b-bac1-d41bd4660027 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:30.929938 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-e5ce9691-3747-481b-bac1-d41bd4660027 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:30.936398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e5ce9691-3747-481b-bac1-d41bd4660027 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:30.936885 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e5ce9691-3747-481b-bac1-d41bd4660027 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:30.937320 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e5ce9691-3747-481b-bac1-d41bd4660027 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:30.938011 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e5ce9691-3747-481b-bac1-d41bd4660027 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:30.938493 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e5ce9691-3747-481b-bac1-d41bd4660027 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:30.938921 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e5ce9691-3747-481b-bac1-d41bd4660027 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:31.068719 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e5ce9691-3747-481b-bac1-d41bd4660027 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:31.077931 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e5ce9691-3747-481b-bac1-d41bd4660027 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:31.079404 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e5ce9691-3747-481b-bac1-d41bd4660027 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:31.080566 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e5ce9691-3747-481b-bac1-d41bd4660027 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.156120 Nov 02 07:34:31.081125 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 324/637] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:30 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:32.105926 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-df498b02-1371-465b-8d7d-910b9e589b05 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:32.106563 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-df498b02-1371-465b-8d7d-910b9e589b05 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:32.113175 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-df498b02-1371-465b-8d7d-910b9e589b05 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:32.113681 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-df498b02-1371-465b-8d7d-910b9e589b05 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:32.114124 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-df498b02-1371-465b-8d7d-910b9e589b05 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:32.114860 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-df498b02-1371-465b-8d7d-910b9e589b05 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:32.115362 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-df498b02-1371-465b-8d7d-910b9e589b05 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:32.115922 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-df498b02-1371-465b-8d7d-910b9e589b05 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:32.245903 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-df498b02-1371-465b-8d7d-910b9e589b05 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:32.254118 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-df498b02-1371-465b-8d7d-910b9e589b05 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:32.255590 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-df498b02-1371-465b-8d7d-910b9e589b05 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:32.256848 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-df498b02-1371-465b-8d7d-910b9e589b05 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.154712 Nov 02 07:34:32.257399 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 314/638] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:32 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:33.281624 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0fc31eba-6d90-4e58-823b-fa8cd130e7ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:33.282225 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-0fc31eba-6d90-4e58-823b-fa8cd130e7ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:33.284685 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:33.290650 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0fc31eba-6d90-4e58-823b-fa8cd130e7ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:33.291135 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0fc31eba-6d90-4e58-823b-fa8cd130e7ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:33.291570 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0fc31eba-6d90-4e58-823b-fa8cd130e7ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:33.292264 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0fc31eba-6d90-4e58-823b-fa8cd130e7ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:33.292719 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0fc31eba-6d90-4e58-823b-fa8cd130e7ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:33.293146 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0fc31eba-6d90-4e58-823b-fa8cd130e7ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:33.428209 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0fc31eba-6d90-4e58-823b-fa8cd130e7ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:33.436941 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0fc31eba-6d90-4e58-823b-fa8cd130e7ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:33.438397 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0fc31eba-6d90-4e58-823b-fa8cd130e7ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:33.439547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0fc31eba-6d90-4e58-823b-fa8cd130e7ce tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.161815 Nov 02 07:34:33.440104 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 325/639] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:33 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:33.527904 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-412536b4-e9dd-40cf-a84f-e04b9b38ce07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:33.528490 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-412536b4-e9dd-40cf-a84f-e04b9b38ce07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:33.535096 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-412536b4-e9dd-40cf-a84f-e04b9b38ce07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:33.535520 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-412536b4-e9dd-40cf-a84f-e04b9b38ce07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:33.535952 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-412536b4-e9dd-40cf-a84f-e04b9b38ce07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:33.536635 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-412536b4-e9dd-40cf-a84f-e04b9b38ce07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:33.537113 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-412536b4-e9dd-40cf-a84f-e04b9b38ce07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:33.537535 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-412536b4-e9dd-40cf-a84f-e04b9b38ce07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:33.555182 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:33.562410 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-412536b4-e9dd-40cf-a84f-e04b9b38ce07 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22/ips" status: 200 len: 150 microversion: 2.1 time: 0.040074 Nov 02 07:34:33.562981 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 315/640] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 07:34:33 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:34:34.465231 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2dfc9c2a-92db-4842-99f1-91f3da9267c1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:34.465835 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2dfc9c2a-92db-4842-99f1-91f3da9267c1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:34.472153 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2dfc9c2a-92db-4842-99f1-91f3da9267c1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:34.472672 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2dfc9c2a-92db-4842-99f1-91f3da9267c1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:34.473101 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2dfc9c2a-92db-4842-99f1-91f3da9267c1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:34.473836 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2dfc9c2a-92db-4842-99f1-91f3da9267c1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:34.474326 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2dfc9c2a-92db-4842-99f1-91f3da9267c1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:34.474769 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2dfc9c2a-92db-4842-99f1-91f3da9267c1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:34.605485 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2dfc9c2a-92db-4842-99f1-91f3da9267c1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:34.614292 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2dfc9c2a-92db-4842-99f1-91f3da9267c1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:34.615882 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2dfc9c2a-92db-4842-99f1-91f3da9267c1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:34.617784 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2dfc9c2a-92db-4842-99f1-91f3da9267c1 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1742 microversion: 2.20 time: 0.156492 Nov 02 07:34:34.618377 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 326/641] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:34 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:34.903142 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-b87a058b-4800-40b3-98e7-85af2aad8ca5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3302ecd7-2015-46e2-9c5c-d80ca092564f"}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:34.905567 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-b87a058b-4800-40b3-98e7-85af2aad8ca5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:34.913642 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b87a058b-4800-40b3-98e7-85af2aad8ca5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:34.914099 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b87a058b-4800-40b3-98e7-85af2aad8ca5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:34.914570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b87a058b-4800-40b3-98e7-85af2aad8ca5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:34.915277 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b87a058b-4800-40b3-98e7-85af2aad8ca5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:34.915730 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b87a058b-4800-40b3-98e7-85af2aad8ca5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:34.916149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b87a058b-4800-40b3-98e7-85af2aad8ca5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:35.205575 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-b87a058b-4800-40b3-98e7-85af2aad8ca5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "POST /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306185 Nov 02 07:34:35.206186 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 316/642] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 07:34:34 2022] POST /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:34:35.643870 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-383f7f52-34a5-4ae4-88a4-6ca4ed1ec3f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:35.644394 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-383f7f52-34a5-4ae4-88a4-6ca4ed1ec3f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:35.651719 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-383f7f52-34a5-4ae4-88a4-6ca4ed1ec3f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:35.652205 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-383f7f52-34a5-4ae4-88a4-6ca4ed1ec3f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:35.652797 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-383f7f52-34a5-4ae4-88a4-6ca4ed1ec3f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:35.653497 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-383f7f52-34a5-4ae4-88a4-6ca4ed1ec3f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:35.653945 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-383f7f52-34a5-4ae4-88a4-6ca4ed1ec3f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:35.654383 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-383f7f52-34a5-4ae4-88a4-6ca4ed1ec3f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:35.658510 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:35.792530 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-383f7f52-34a5-4ae4-88a4-6ca4ed1ec3f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:35.800491 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-383f7f52-34a5-4ae4-88a4-6ca4ed1ec3f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:35.801924 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-383f7f52-34a5-4ae4-88a4-6ca4ed1ec3f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:35.803319 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-383f7f52-34a5-4ae4-88a4-6ca4ed1ec3f6 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1742 microversion: 2.20 time: 0.163322 Nov 02 07:34:35.804547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 327/643] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:35 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:36.830002 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-55a1db31-ac1b-4c00-804a-048663e04b12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:36.830929 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-55a1db31-ac1b-4c00-804a-048663e04b12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:36.839563 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-55a1db31-ac1b-4c00-804a-048663e04b12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:36.839945 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-55a1db31-ac1b-4c00-804a-048663e04b12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:36.840857 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-55a1db31-ac1b-4c00-804a-048663e04b12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:36.841594 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-55a1db31-ac1b-4c00-804a-048663e04b12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:36.842209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-55a1db31-ac1b-4c00-804a-048663e04b12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:36.842814 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-55a1db31-ac1b-4c00-804a-048663e04b12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:36.996404 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-55a1db31-ac1b-4c00-804a-048663e04b12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:37.008833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-55a1db31-ac1b-4c00-804a-048663e04b12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:37.011292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-55a1db31-ac1b-4c00-804a-048663e04b12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:37.013229 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-55a1db31-ac1b-4c00-804a-048663e04b12 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1737 microversion: 2.20 time: 0.188243 Nov 02 07:34:37.045202 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 317/644] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:36 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:38.045977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c991e48c-36fc-4fa4-a0f6-619fad1e2bb4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:38.047005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c991e48c-36fc-4fa4-a0f6-619fad1e2bb4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:38.055621 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c991e48c-36fc-4fa4-a0f6-619fad1e2bb4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:38.056664 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c991e48c-36fc-4fa4-a0f6-619fad1e2bb4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:38.057180 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c991e48c-36fc-4fa4-a0f6-619fad1e2bb4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:38.058024 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c991e48c-36fc-4fa4-a0f6-619fad1e2bb4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:38.058650 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c991e48c-36fc-4fa4-a0f6-619fad1e2bb4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:38.059076 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c991e48c-36fc-4fa4-a0f6-619fad1e2bb4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:38.239643 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-d8be4771-8a79-48da-8261-6cdad6820726 req-b5e76ad5-1d03-4280-89de-b90e6c267929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e24f861-ba20-4595-9dd5-9ea1f9832284", "name": "network-vif-plugged", "status": "completed", "tag": "9b205abf-2fab-4e5a-9b1e-0110c74b9f93"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:38.262181 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-d8be4771-8a79-48da-8261-6cdad6820726 req-b5e76ad5-1d03-4280-89de-b90e6c267929 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:38.262859 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-d8be4771-8a79-48da-8261-6cdad6820726 req-b5e76ad5-1d03-4280-89de-b90e6c267929 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:38.263462 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-d8be4771-8a79-48da-8261-6cdad6820726 req-b5e76ad5-1d03-4280-89de-b90e6c267929 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:38.264272 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c991e48c-36fc-4fa4-a0f6-619fad1e2bb4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:38.276348 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-d8be4771-8a79-48da-8261-6cdad6820726 req-b5e76ad5-1d03-4280-89de-b90e6c267929 service nova] Creating event network-vif-plugged:9b205abf-2fab-4e5a-9b1e-0110c74b9f93 for instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 on hv-cinder-80473 Nov 02 07:34:38.278945 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c991e48c-36fc-4fa4-a0f6-619fad1e2bb4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:38.281780 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-d8be4771-8a79-48da-8261-6cdad6820726 req-b5e76ad5-1d03-4280-89de-b90e6c267929 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047158 Nov 02 07:34:38.282572 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 318/645] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:34:38.282914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c991e48c-36fc-4fa4-a0f6-619fad1e2bb4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:38.284083 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c991e48c-36fc-4fa4-a0f6-619fad1e2bb4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1737 microversion: 2.20 time: 0.243261 Nov 02 07:34:38.290586 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 328/646] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:38 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1737 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:39.310166 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9f47375c-2fa3-499d-bd7b-819f8e497911 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:39.311642 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9f47375c-2fa3-499d-bd7b-819f8e497911 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:39.318856 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f47375c-2fa3-499d-bd7b-819f8e497911 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:39.319473 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f47375c-2fa3-499d-bd7b-819f8e497911 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:39.320215 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f47375c-2fa3-499d-bd7b-819f8e497911 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:39.321144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f47375c-2fa3-499d-bd7b-819f8e497911 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:39.321830 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f47375c-2fa3-499d-bd7b-819f8e497911 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:39.322493 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9f47375c-2fa3-499d-bd7b-819f8e497911 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:39.480716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9f47375c-2fa3-499d-bd7b-819f8e497911 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:39.489835 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9f47375c-2fa3-499d-bd7b-819f8e497911 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:39.491903 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9f47375c-2fa3-499d-bd7b-819f8e497911 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:39.494190 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9f47375c-2fa3-499d-bd7b-819f8e497911 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1737 microversion: 2.20 time: 0.188766 Nov 02 07:34:39.494790 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 319/647] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:39 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:40.520050 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0567ea77-a3ae-4297-98ab-2596296555aa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:40.521405 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-0567ea77-a3ae-4297-98ab-2596296555aa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:40.529361 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0567ea77-a3ae-4297-98ab-2596296555aa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:40.530183 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0567ea77-a3ae-4297-98ab-2596296555aa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:40.530690 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0567ea77-a3ae-4297-98ab-2596296555aa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:40.531582 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0567ea77-a3ae-4297-98ab-2596296555aa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:40.532039 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0567ea77-a3ae-4297-98ab-2596296555aa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:40.532599 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0567ea77-a3ae-4297-98ab-2596296555aa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:40.714858 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0567ea77-a3ae-4297-98ab-2596296555aa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:40.723341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0567ea77-a3ae-4297-98ab-2596296555aa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:40.724916 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0567ea77-a3ae-4297-98ab-2596296555aa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:40.726784 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0567ea77-a3ae-4297-98ab-2596296555aa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1737 microversion: 2.20 time: 0.210551 Nov 02 07:34:40.727637 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 329/648] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:40 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:41.754549 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-700bb478-0369-4d81-bc9d-45c6becef52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:41.755152 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-700bb478-0369-4d81-bc9d-45c6becef52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:41.765875 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-700bb478-0369-4d81-bc9d-45c6becef52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:41.766398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-700bb478-0369-4d81-bc9d-45c6becef52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:41.766820 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-700bb478-0369-4d81-bc9d-45c6becef52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:41.767520 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-700bb478-0369-4d81-bc9d-45c6becef52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:41.768290 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-700bb478-0369-4d81-bc9d-45c6becef52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:41.768898 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-700bb478-0369-4d81-bc9d-45c6becef52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:41.919498 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-700bb478-0369-4d81-bc9d-45c6becef52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:41.928414 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-700bb478-0369-4d81-bc9d-45c6becef52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:41.930140 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-700bb478-0369-4d81-bc9d-45c6becef52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:41.931428 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-700bb478-0369-4d81-bc9d-45c6becef52f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1737 microversion: 2.20 time: 0.180962 Nov 02 07:34:41.932528 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 320/649] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:41 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:42.922655 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8489a790-f2c4-445e-9615-cc2f35b81ecf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3302ecd7-2015-46e2-9c5c-d80ca092564f"}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:42.925996 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8489a790-f2c4-445e-9615-cc2f35b81ecf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:42.934480 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8489a790-f2c4-445e-9615-cc2f35b81ecf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:42.935680 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8489a790-f2c4-445e-9615-cc2f35b81ecf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:42.936224 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8489a790-f2c4-445e-9615-cc2f35b81ecf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:42.937082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8489a790-f2c4-445e-9615-cc2f35b81ecf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:42.937554 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8489a790-f2c4-445e-9615-cc2f35b81ecf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:42.938182 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8489a790-f2c4-445e-9615-cc2f35b81ecf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:42.958074 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-cfb72817-c59f-475d-9898-7b6f36a099a9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:42.958828 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-cfb72817-c59f-475d-9898-7b6f36a099a9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:42.967300 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cfb72817-c59f-475d-9898-7b6f36a099a9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:42.967888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cfb72817-c59f-475d-9898-7b6f36a099a9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:42.968411 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cfb72817-c59f-475d-9898-7b6f36a099a9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:42.969206 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cfb72817-c59f-475d-9898-7b6f36a099a9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:42.969912 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cfb72817-c59f-475d-9898-7b6f36a099a9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:42.970433 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-cfb72817-c59f-475d-9898-7b6f36a099a9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:43.040253 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-8489a790-f2c4-445e-9615-cc2f35b81ecf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] HTTP exception thrown: Invalid volume: volume 3302ecd7-2015-46e2-9c5c-d80ca092564f is already attached to instances: 7bd1bfac-3396-4f20-bb69-0ce371638a22 Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8489a790-f2c4-445e-9615-cc2f35b81ecf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Request method failure captured: Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: POST /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22/os-volume_attachments HTTP/1.1 Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 74 Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhytX4Fqrx49tZr8XMSeqOuiVVe5QhR5pSkx822MlHR1MwQprRFdpyDwzWSFm2fCfS3S5s_QIudHlvHUSGGla4ObJvPgMlXRPp30GlwXPuRdB_YwvXPaPkzMw2fsaqcBcgnloHZe9knHcPTV7sOfEXdhYljLTd7gzyDjmltPZHCDm9w Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:34:43.043392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:34:43.045819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba3bab98d31d49098a8e7242d51be646", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:34:43.045819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:34:43.045819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:34:43.045819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:34:43.045819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:34:43.045819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:34:43.045819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:34:43.045819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 47965dc7f5964bbfa4efff0822530965 Nov 02 07:34:43.045819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:34:43.045819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Nov 02 07:34:43.045819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {"volumeAttachment": {"volumeId": "3302ecd7-2015-46e2-9c5c-d80ca092564f"}} Nov 02 07:34:43.045819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Invalid volume: volume 3302ecd7-2015-46e2-9c5c-d80ca092564f is already attached to instances: 7bd1bfac-3396-4f20-bb69-0ce371638a22 Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'server_id': '7bd1bfac-3396-4f20-bb69-0ce371638a22', 'body': {'volumeAttachment': {'volumeId': '3302ecd7-2015-46e2-9c5c-d80ca092564f'}}} Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3302ecd7-2015-46e2-9c5c-d80ca092564f is already attached to instances: 7bd1bfac-3396-4f20-bb69-0ce371638a22 Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:34:43.047536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3302ecd7-2015-46e2-9c5c-d80ca092564f is already attached to instances: 7bd1bfac-3396-4f20-bb69-0ce371638a22 Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:34:43.048914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:34:43.050328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:34:43.050328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:34:43.050328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:34:43.050328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3302ecd7-2015-46e2-9c5c-d80ca092564f is already attached to instances: 7bd1bfac-3396-4f20-bb69-0ce371638a22 Nov 02 07:34:43.050328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:34:43.051414 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8489a790-f2c4-445e-9615-cc2f35b81ecf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Returning 400 to user: Invalid volume: volume 3302ecd7-2015-46e2-9c5c-d80ca092564f is already attached to instances: 7bd1bfac-3396-4f20-bb69-0ce371638a22 {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:34:43.053077 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8489a790-f2c4-445e-9615-cc2f35b81ecf tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "POST /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134898 Nov 02 07:34:43.053943 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 330/650] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 07:34:42 2022] POST /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 07:34:43.132906 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-cfb72817-c59f-475d-9898-7b6f36a099a9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:43.137304 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-cb874501-dc55-4c36-a952-283cb4d19b99 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:43.137806 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-cb874501-dc55-4c36-a952-283cb4d19b99 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:43.142037 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-cfb72817-c59f-475d-9898-7b6f36a099a9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:43.143506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-cfb72817-c59f-475d-9898-7b6f36a099a9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:43.144550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cb874501-dc55-4c36-a952-283cb4d19b99 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:43.145098 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cb874501-dc55-4c36-a952-283cb4d19b99 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:43.145222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-cfb72817-c59f-475d-9898-7b6f36a099a9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1737 microversion: 2.20 time: 0.192355 Nov 02 07:34:43.145608 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cb874501-dc55-4c36-a952-283cb4d19b99 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:43.146395 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cb874501-dc55-4c36-a952-283cb4d19b99 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:43.146909 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cb874501-dc55-4c36-a952-283cb4d19b99 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:43.147959 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cb874501-dc55-4c36-a952-283cb4d19b99 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:43.151795 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 321/651] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:42 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:43.264195 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.objects.instance [None req-cb874501-dc55-4c36-a952-283cb4d19b99 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lazy-loading 'services' on Instance uuid 7bd1bfac-3396-4f20-bb69-0ce371638a22 {{(pid=118991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:34:43.349009 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-cb874501-dc55-4c36-a952-283cb4d19b99 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22/os-volume_attachments/3302ecd7-2015-46e2-9c5c-d80ca092564f" status: 202 len: 0 microversion: 2.1 time: 0.215601 Nov 02 07:34:43.354353 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 331/652] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 07:34:43 2022] DELETE /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22/os-volume_attachments/3302ecd7-2015-46e2-9c5c-d80ca092564f => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:34:43.367359 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-b637e1b8-095a-4661-abc0-2dd3a99ea18d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:43.379014 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-b637e1b8-095a-4661-abc0-2dd3a99ea18d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:43.387706 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b637e1b8-095a-4661-abc0-2dd3a99ea18d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:43.388507 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b637e1b8-095a-4661-abc0-2dd3a99ea18d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:43.389175 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b637e1b8-095a-4661-abc0-2dd3a99ea18d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:43.390101 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b637e1b8-095a-4661-abc0-2dd3a99ea18d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:43.390782 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b637e1b8-095a-4661-abc0-2dd3a99ea18d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:43.391427 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b637e1b8-095a-4661-abc0-2dd3a99ea18d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:43.430087 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-b637e1b8-095a-4661-abc0-2dd3a99ea18d tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075395 Nov 02 07:34:43.431266 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 322/653] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 07:34:43 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:34:44.172933 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0d3fb354-3c06-4853-9bc9-61a12e695e08 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:44.173628 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-0d3fb354-3c06-4853-9bc9-61a12e695e08 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:44.188210 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0d3fb354-3c06-4853-9bc9-61a12e695e08 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:44.188696 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0d3fb354-3c06-4853-9bc9-61a12e695e08 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:44.189335 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0d3fb354-3c06-4853-9bc9-61a12e695e08 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:44.190271 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0d3fb354-3c06-4853-9bc9-61a12e695e08 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:44.190945 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0d3fb354-3c06-4853-9bc9-61a12e695e08 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:44.191364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0d3fb354-3c06-4853-9bc9-61a12e695e08 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:44.355667 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0d3fb354-3c06-4853-9bc9-61a12e695e08 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:44.367865 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0d3fb354-3c06-4853-9bc9-61a12e695e08 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:44.374231 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0d3fb354-3c06-4853-9bc9-61a12e695e08 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:44.375839 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0d3fb354-3c06-4853-9bc9-61a12e695e08 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1737 microversion: 2.20 time: 0.207530 Nov 02 07:34:44.376531 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 332/654] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:44 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:44.451450 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6e5f8396-4ff7-4f66-8c57-b1a63da953c0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:44.458280 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-6e5f8396-4ff7-4f66-8c57-b1a63da953c0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:44.473734 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6e5f8396-4ff7-4f66-8c57-b1a63da953c0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:44.474764 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6e5f8396-4ff7-4f66-8c57-b1a63da953c0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:44.475512 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6e5f8396-4ff7-4f66-8c57-b1a63da953c0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:44.476943 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6e5f8396-4ff7-4f66-8c57-b1a63da953c0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:44.477595 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6e5f8396-4ff7-4f66-8c57-b1a63da953c0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:44.478015 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6e5f8396-4ff7-4f66-8c57-b1a63da953c0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:44.515654 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-6e5f8396-4ff7-4f66-8c57-b1a63da953c0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076459 Nov 02 07:34:44.516380 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 323/655] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 07:34:44 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 07:34:44.602224 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-88f46ec0-3953-4573-8453-eccf691b3837 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:44.603000 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-88f46ec0-3953-4573-8453-eccf691b3837 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:44.611347 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-88f46ec0-3953-4573-8453-eccf691b3837 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:44.612075 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-88f46ec0-3953-4573-8453-eccf691b3837 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:44.613098 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-88f46ec0-3953-4573-8453-eccf691b3837 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:44.614306 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-88f46ec0-3953-4573-8453-eccf691b3837 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:44.615686 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-88f46ec0-3953-4573-8453-eccf691b3837 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:44.617628 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-88f46ec0-3953-4573-8453-eccf691b3837 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:44.665012 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-88f46ec0-3953-4573-8453-eccf691b3837 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Going to try to terminate instance {{(pid=118991) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:34:44.759334 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-88f46ec0-3953-4573-8453-eccf691b3837 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 204 len: 0 microversion: 2.1 time: 0.163690 Nov 02 07:34:44.760377 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 333/656] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:34:44 2022] DELETE /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:34:44.769589 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3ab96917-d464-4a20-8cad-5b17bb09fd1b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:44.770769 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3ab96917-d464-4a20-8cad-5b17bb09fd1b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:44.778387 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3ab96917-d464-4a20-8cad-5b17bb09fd1b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:44.779189 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3ab96917-d464-4a20-8cad-5b17bb09fd1b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:44.779828 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3ab96917-d464-4a20-8cad-5b17bb09fd1b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:44.780847 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3ab96917-d464-4a20-8cad-5b17bb09fd1b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:44.781659 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3ab96917-d464-4a20-8cad-5b17bb09fd1b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:44.782824 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3ab96917-d464-4a20-8cad-5b17bb09fd1b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:45.016617 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3ab96917-d464-4a20-8cad-5b17bb09fd1b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:45.027364 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3ab96917-d464-4a20-8cad-5b17bb09fd1b tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 200 len: 1681 microversion: 2.1 time: 0.262067 Nov 02 07:34:45.045980 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 324/657] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:44 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 1681 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:45.407125 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d71d2e6f-e01d-4b84-a8a7-0345e325e46f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:45.408451 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-d71d2e6f-e01d-4b84-a8a7-0345e325e46f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:45.416649 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d71d2e6f-e01d-4b84-a8a7-0345e325e46f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:45.417473 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d71d2e6f-e01d-4b84-a8a7-0345e325e46f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:45.418116 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d71d2e6f-e01d-4b84-a8a7-0345e325e46f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:45.419085 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d71d2e6f-e01d-4b84-a8a7-0345e325e46f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:45.419748 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d71d2e6f-e01d-4b84-a8a7-0345e325e46f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:45.420397 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d71d2e6f-e01d-4b84-a8a7-0345e325e46f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:45.543514 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-799bf6ea-c770-43dd-bfcd-27cf196db99c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:45.544909 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-799bf6ea-c770-43dd-bfcd-27cf196db99c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:45.560538 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-799bf6ea-c770-43dd-bfcd-27cf196db99c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:45.561865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-799bf6ea-c770-43dd-bfcd-27cf196db99c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:45.567325 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-799bf6ea-c770-43dd-bfcd-27cf196db99c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:45.568437 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-799bf6ea-c770-43dd-bfcd-27cf196db99c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:45.572237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-799bf6ea-c770-43dd-bfcd-27cf196db99c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:45.573525 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-799bf6ea-c770-43dd-bfcd-27cf196db99c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:45.593106 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d71d2e6f-e01d-4b84-a8a7-0345e325e46f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:45.609246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d71d2e6f-e01d-4b84-a8a7-0345e325e46f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:45.610651 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-799bf6ea-c770-43dd-bfcd-27cf196db99c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lazy-loading 'flavor' on Instance uuid 22ad3728-5dee-49b1-a62d-3bdfca6b47ce {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:34:45.610774 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d71d2e6f-e01d-4b84-a8a7-0345e325e46f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:45.611910 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d71d2e6f-e01d-4b84-a8a7-0345e325e46f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1737 microversion: 2.20 time: 0.212361 Nov 02 07:34:45.612479 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 334/658] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:45 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:45.733066 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-799bf6ea-c770-43dd-bfcd-27cf196db99c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "POST /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce/action" status: 202 len: 0 microversion: 2.1 time: 0.195039 Nov 02 07:34:45.734008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 325/659] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 07:34:45 2022] POST /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:34:45.743195 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ee5943bf-3451-4f73-a40c-769f32d1fa90 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:45.744160 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-ee5943bf-3451-4f73-a40c-769f32d1fa90 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:45.751910 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ee5943bf-3451-4f73-a40c-769f32d1fa90 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:45.752910 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ee5943bf-3451-4f73-a40c-769f32d1fa90 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:45.753513 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ee5943bf-3451-4f73-a40c-769f32d1fa90 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:45.754460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ee5943bf-3451-4f73-a40c-769f32d1fa90 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:45.755792 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ee5943bf-3451-4f73-a40c-769f32d1fa90 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:45.756362 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ee5943bf-3451-4f73-a40c-769f32d1fa90 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:45.967569 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ee5943bf-3451-4f73-a40c-769f32d1fa90 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:45.976915 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ee5943bf-3451-4f73-a40c-769f32d1fa90 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.237112 Nov 02 07:34:45.990991 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 335/660] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:45 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:34:46.055593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-95a47c63-afb1-4d13-aba8-9ce3a6b59a58 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:46.056229 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-95a47c63-afb1-4d13-aba8-9ce3a6b59a58 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:46.065247 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-95a47c63-afb1-4d13-aba8-9ce3a6b59a58 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:46.065752 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-95a47c63-afb1-4d13-aba8-9ce3a6b59a58 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:46.066182 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-95a47c63-afb1-4d13-aba8-9ce3a6b59a58 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:46.066935 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-95a47c63-afb1-4d13-aba8-9ce3a6b59a58 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:46.067388 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-95a47c63-afb1-4d13-aba8-9ce3a6b59a58 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:46.068514 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-95a47c63-afb1-4d13-aba8-9ce3a6b59a58 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:46.251729 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-95a47c63-afb1-4d13-aba8-9ce3a6b59a58 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:46.261454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-95a47c63-afb1-4d13-aba8-9ce3a6b59a58 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 200 len: 1681 microversion: 2.1 time: 0.212024 Nov 02 07:34:46.262393 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 326/661] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:46 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:46.639800 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-9be51b80-fa87-4d46-8258-5ff09cc0081c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:46.640408 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-9be51b80-fa87-4d46-8258-5ff09cc0081c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:46.647459 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9be51b80-fa87-4d46-8258-5ff09cc0081c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:46.649257 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9be51b80-fa87-4d46-8258-5ff09cc0081c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:46.649913 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9be51b80-fa87-4d46-8258-5ff09cc0081c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:46.650963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9be51b80-fa87-4d46-8258-5ff09cc0081c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:46.651673 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9be51b80-fa87-4d46-8258-5ff09cc0081c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:46.652287 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9be51b80-fa87-4d46-8258-5ff09cc0081c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:46.910727 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-9be51b80-fa87-4d46-8258-5ff09cc0081c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:46.921389 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-9be51b80-fa87-4d46-8258-5ff09cc0081c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:46.923161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-9be51b80-fa87-4d46-8258-5ff09cc0081c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:46.925092 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-9be51b80-fa87-4d46-8258-5ff09cc0081c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1737 microversion: 2.20 time: 0.289175 Nov 02 07:34:46.938384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 336/662] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:46 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1737 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:47.002656 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-bbbbb75d-f74a-4496-af6d-9ab10e3fbb47 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:47.004365 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-bbbbb75d-f74a-4496-af6d-9ab10e3fbb47 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:47.017466 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bbbbb75d-f74a-4496-af6d-9ab10e3fbb47 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:47.018209 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bbbbb75d-f74a-4496-af6d-9ab10e3fbb47 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:47.018681 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bbbbb75d-f74a-4496-af6d-9ab10e3fbb47 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:47.019404 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bbbbb75d-f74a-4496-af6d-9ab10e3fbb47 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:47.019864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bbbbb75d-f74a-4496-af6d-9ab10e3fbb47 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:47.020287 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bbbbb75d-f74a-4496-af6d-9ab10e3fbb47 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:47.290786 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-7812f464-2310-471e-ae90-bd6e0f469cee tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:47.294579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-7812f464-2310-471e-ae90-bd6e0f469cee tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:47.297742 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7812f464-2310-471e-ae90-bd6e0f469cee tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:47.298224 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7812f464-2310-471e-ae90-bd6e0f469cee tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:47.298680 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7812f464-2310-471e-ae90-bd6e0f469cee tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:47.299553 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7812f464-2310-471e-ae90-bd6e0f469cee tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:47.300080 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7812f464-2310-471e-ae90-bd6e0f469cee tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:47.300514 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7812f464-2310-471e-ae90-bd6e0f469cee tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:47.316901 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-bbbbb75d-f74a-4496-af6d-9ab10e3fbb47 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:47.331575 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-bbbbb75d-f74a-4496-af6d-9ab10e3fbb47 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.333863 Nov 02 07:34:47.333849 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 327/663] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:46 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:47.521262 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7812f464-2310-471e-ae90-bd6e0f469cee tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:47.530121 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-7812f464-2310-471e-ae90-bd6e0f469cee tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 200 len: 1681 microversion: 2.1 time: 0.243669 Nov 02 07:34:47.530716 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 337/664] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:47 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 1681 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:34:47.888349 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-9a8985ca-800a-4cae-b37f-13449bf47b7b req-5a5d197f-9e03-4ff3-b604-fac5af5d5edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bd1bfac-3396-4f20-bb69-0ce371638a22", "name": "network-vif-deleted", "tag": "148621bd-7213-4c12-9515-64da33ea6ed5"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:47.908458 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-9a8985ca-800a-4cae-b37f-13449bf47b7b req-5a5d197f-9e03-4ff3-b604-fac5af5d5edd service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:47.908940 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-9a8985ca-800a-4cae-b37f-13449bf47b7b req-5a5d197f-9e03-4ff3-b604-fac5af5d5edd service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:47.909464 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-9a8985ca-800a-4cae-b37f-13449bf47b7b req-5a5d197f-9e03-4ff3-b604-fac5af5d5edd service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:47.932477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-9a8985ca-800a-4cae-b37f-13449bf47b7b req-5a5d197f-9e03-4ff3-b604-fac5af5d5edd service nova] Creating event network-vif-deleted:148621bd-7213-4c12-9515-64da33ea6ed5 for instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 on hv-cinder-80473 Nov 02 07:34:47.953396 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-75fb0e29-17a3-4c37-9400-9ff0563cd7c0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:47.954880 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-75fb0e29-17a3-4c37-9400-9ff0563cd7c0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:47.958177 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-9a8985ca-800a-4cae-b37f-13449bf47b7b req-5a5d197f-9e03-4ff3-b604-fac5af5d5edd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073300 Nov 02 07:34:47.958826 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 328/665] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:34:47.968398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-75fb0e29-17a3-4c37-9400-9ff0563cd7c0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:47.969287 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-75fb0e29-17a3-4c37-9400-9ff0563cd7c0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:47.969872 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-75fb0e29-17a3-4c37-9400-9ff0563cd7c0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:47.970903 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-75fb0e29-17a3-4c37-9400-9ff0563cd7c0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:47.972067 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-75fb0e29-17a3-4c37-9400-9ff0563cd7c0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:47.972720 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-75fb0e29-17a3-4c37-9400-9ff0563cd7c0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:48.206962 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-75fb0e29-17a3-4c37-9400-9ff0563cd7c0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:48.218571 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-75fb0e29-17a3-4c37-9400-9ff0563cd7c0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:48.220521 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-75fb0e29-17a3-4c37-9400-9ff0563cd7c0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:48.236235 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-75fb0e29-17a3-4c37-9400-9ff0563cd7c0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1719 microversion: 2.20 time: 0.287824 Nov 02 07:34:48.238150 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 338/666] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:47 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1719 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:48.359515 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-547a0c34-441a-428c-93a1-d67040fb97d9 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:48.360245 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-547a0c34-441a-428c-93a1-d67040fb97d9 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:48.366992 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-547a0c34-441a-428c-93a1-d67040fb97d9 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:48.367418 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-547a0c34-441a-428c-93a1-d67040fb97d9 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:48.367855 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-547a0c34-441a-428c-93a1-d67040fb97d9 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:48.368551 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-547a0c34-441a-428c-93a1-d67040fb97d9 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:48.369005 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-547a0c34-441a-428c-93a1-d67040fb97d9 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:48.369456 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-547a0c34-441a-428c-93a1-d67040fb97d9 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:48.501372 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-547a0c34-441a-428c-93a1-d67040fb97d9 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:48.510061 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-547a0c34-441a-428c-93a1-d67040fb97d9 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.155478 Nov 02 07:34:48.510682 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 329/667] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:48 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:48.555487 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5c45f3df-67fb-424e-95f9-cfd0878cdea9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:48.556469 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-5c45f3df-67fb-424e-95f9-cfd0878cdea9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:48.564198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5c45f3df-67fb-424e-95f9-cfd0878cdea9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:48.564785 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5c45f3df-67fb-424e-95f9-cfd0878cdea9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:48.565327 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5c45f3df-67fb-424e-95f9-cfd0878cdea9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:48.566314 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5c45f3df-67fb-424e-95f9-cfd0878cdea9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:48.566982 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5c45f3df-67fb-424e-95f9-cfd0878cdea9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:48.567485 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5c45f3df-67fb-424e-95f9-cfd0878cdea9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:48.606644 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5c45f3df-67fb-424e-95f9-cfd0878cdea9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:48.607206 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5c45f3df-67fb-424e-95f9-cfd0878cdea9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:48.607705 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5c45f3df-67fb-424e-95f9-cfd0878cdea9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:48.608194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.objects.instance [None req-5c45f3df-67fb-424e-95f9-cfd0878cdea9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lazy-loading 'fault' on Instance uuid 7bd1bfac-3396-4f20-bb69-0ce371638a22 {{(pid=118991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:34:48.690852 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-5c45f3df-67fb-424e-95f9-cfd0878cdea9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:48.701567 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-5c45f3df-67fb-424e-95f9-cfd0878cdea9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 200 len: 1330 microversion: 2.1 time: 0.150647 Nov 02 07:34:48.702627 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 339/668] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:48 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 1330 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:34:49.273570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-bdc7e7b6-d806-4b29-98d9-89ea64171ce0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:49.274020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-bdc7e7b6-d806-4b29-98d9-89ea64171ce0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:49.279928 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bdc7e7b6-d806-4b29-98d9-89ea64171ce0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:49.290691 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bdc7e7b6-d806-4b29-98d9-89ea64171ce0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:49.290691 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bdc7e7b6-d806-4b29-98d9-89ea64171ce0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:49.290691 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bdc7e7b6-d806-4b29-98d9-89ea64171ce0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:49.290691 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bdc7e7b6-d806-4b29-98d9-89ea64171ce0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:49.291167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bdc7e7b6-d806-4b29-98d9-89ea64171ce0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:49.301578 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:49.420109 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-bdc7e7b6-d806-4b29-98d9-89ea64171ce0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:49.429529 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-bdc7e7b6-d806-4b29-98d9-89ea64171ce0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:49.431014 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-bdc7e7b6-d806-4b29-98d9-89ea64171ce0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:49.432178 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-bdc7e7b6-d806-4b29-98d9-89ea64171ce0 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1719 microversion: 2.20 time: 0.164017 Nov 02 07:34:49.432736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 330/669] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:49 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:49.534379 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-db642374-c517-4168-8153-d56cca9914df tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:49.535004 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-db642374-c517-4168-8153-d56cca9914df tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:49.542206 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-db642374-c517-4168-8153-d56cca9914df tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:49.542717 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-db642374-c517-4168-8153-d56cca9914df tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:49.543158 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-db642374-c517-4168-8153-d56cca9914df tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:49.543847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-db642374-c517-4168-8153-d56cca9914df tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:49.544298 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-db642374-c517-4168-8153-d56cca9914df tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:49.544722 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-db642374-c517-4168-8153-d56cca9914df tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:49.681248 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-db642374-c517-4168-8153-d56cca9914df tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:49.688829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-db642374-c517-4168-8153-d56cca9914df tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.158494 Nov 02 07:34:49.689384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 340/670] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:49 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:49.725015 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-124fddba-88ee-424e-83f7-de9fbe1dd632 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:49.726162 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-124fddba-88ee-424e-83f7-de9fbe1dd632 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:49.732044 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-124fddba-88ee-424e-83f7-de9fbe1dd632 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:49.732522 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-124fddba-88ee-424e-83f7-de9fbe1dd632 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:49.732946 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-124fddba-88ee-424e-83f7-de9fbe1dd632 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:49.733621 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-124fddba-88ee-424e-83f7-de9fbe1dd632 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:49.734062 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-124fddba-88ee-424e-83f7-de9fbe1dd632 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:49.734501 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-124fddba-88ee-424e-83f7-de9fbe1dd632 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:49.749620 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-124fddba-88ee-424e-83f7-de9fbe1dd632 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] HTTP exception thrown: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-124fddba-88ee-424e-83f7-de9fbe1dd632 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Request method failure captured: Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 HTTP/1.1 Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhytX4Fqrx49tZr8XMSeqOuiVVe5QhR5pSkx822MlHR1MwQprRFdpyDwzWSFm2fCfS3S5s_QIudHlvHUSGGla4ObJvPgMlXRPp30GlwXPuRdB_YwvXPaPkzMw2fsaqcBcgnloHZe9knHcPTV7sOfEXdhYljLTd7gzyDjmltPZHCDm9w Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:34:49.751243 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:34:49.753011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba3bab98d31d49098a8e7242d51be646", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:34:49.753011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:34:49.753011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:34:49.753011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:34:49.753011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:34:49.753011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:34:49.753011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:34:49.753011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 47965dc7f5964bbfa4efff0822530965 Nov 02 07:34:49.753011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:34:49.753011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:34:49.753011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. Nov 02 07:34:49.753011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '7bd1bfac-3396-4f20-bb69-0ce371638a22'} Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:34:49.753810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. Nov 02 07:34:49.755237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:34:49.756543 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-124fddba-88ee-424e-83f7-de9fbe1dd632 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Returning 404 to user: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:34:49.756543 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-124fddba-88ee-424e-83f7-de9fbe1dd632 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 404 len: 111 microversion: 2.1 time: 0.031679 Nov 02 07:34:49.756543 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 331/671] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:49 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:34:49.761823 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a14a0471-b363-43b6-ae1f-1cd0d3bb2bfe tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '.version_select at 0x7f4d6a2f8d30>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:49.780574 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a14a0471-b363-43b6-ae1f-1cd0d3bb2bfe tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111093897" status: 202 len: 0 microversion: 2.1 time: 0.022403 Nov 02 07:34:49.781123 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 341/672] 10.222.0.18 () {58 vars in 1221 bytes} [Wed Nov 2 07:34:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111093897 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:34:50.271939 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-7189d193-8238-4199-b758-1826561240e1 req-2676fa49-7427-46b1-ad52-973f48ff8f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e24f861-ba20-4595-9dd5-9ea1f9832284", "name": "network-vif-unplugged", "status": "completed", "tag": "9b205abf-2fab-4e5a-9b1e-0110c74b9f93"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:50.282804 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-7189d193-8238-4199-b758-1826561240e1 req-2676fa49-7427-46b1-ad52-973f48ff8f96 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:50.283360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-7189d193-8238-4199-b758-1826561240e1 req-2676fa49-7427-46b1-ad52-973f48ff8f96 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:50.283878 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-7189d193-8238-4199-b758-1826561240e1 req-2676fa49-7427-46b1-ad52-973f48ff8f96 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:50.298328 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-7189d193-8238-4199-b758-1826561240e1 req-2676fa49-7427-46b1-ad52-973f48ff8f96 service nova] Creating event network-vif-unplugged:9b205abf-2fab-4e5a-9b1e-0110c74b9f93 for instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 on hv-cinder-80473 Nov 02 07:34:50.303358 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-7189d193-8238-4199-b758-1826561240e1 req-2676fa49-7427-46b1-ad52-973f48ff8f96 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035007 Nov 02 07:34:50.304770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 332/673] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:34:50.403375 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-29aa9ce1-02c1-4f6a-97d4-9bfcde6046d8 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Action: 'create', calling method: .version_select at 0x7f4d6a26ca60>, body: {"keypair": {"name": "tempest-keypair-152485710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKblJU6+8Oymdw76uAcDBrAtAyJOR+pl57eADaIO8PW8L52VZCPrl+mJoel58NfPu2s9TAmcZLf6yFYmZaKgN5ET8PS/CRfFUunQpmoqjrUKtyajzNcGJ2zNBmbvMsf29Q=="}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:50.427074 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-29aa9ce1-02c1-4f6a-97d4-9bfcde6046d8 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Getting quotas for project ba3bab98d31d49098a8e7242d51be646. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:34:50.432218 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-29aa9ce1-02c1-4f6a-97d4-9bfcde6046d8 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Getting quotas for user 47965dc7f5964bbfa4efff0822530965 and project ba3bab98d31d49098a8e7242d51be646. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:34:50.456323 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-29aa9ce1-02c1-4f6a-97d4-9bfcde6046d8 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057680 Nov 02 07:34:50.457102 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 342/674] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 07:34:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:34:50.458914 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c931ba29-b31a-42ec-bca5-0640bfd24cc4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:50.459674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c931ba29-b31a-42ec-bca5-0640bfd24cc4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:50.467290 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c931ba29-b31a-42ec-bca5-0640bfd24cc4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:50.467770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c931ba29-b31a-42ec-bca5-0640bfd24cc4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:50.468198 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c931ba29-b31a-42ec-bca5-0640bfd24cc4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:50.468895 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c931ba29-b31a-42ec-bca5-0640bfd24cc4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:50.469344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c931ba29-b31a-42ec-bca5-0640bfd24cc4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:50.469763 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c931ba29-b31a-42ec-bca5-0640bfd24cc4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:50.666598 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c931ba29-b31a-42ec-bca5-0640bfd24cc4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:50.678505 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c931ba29-b31a-42ec-bca5-0640bfd24cc4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:50.682740 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c931ba29-b31a-42ec-bca5-0640bfd24cc4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:50.684372 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c931ba29-b31a-42ec-bca5-0640bfd24cc4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1719 microversion: 2.20 time: 0.229766 Nov 02 07:34:50.685864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 333/675] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:50 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1719 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:34:50.714083 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-bc0abcad-4374-43d1-be58-d77a7e224014 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:50.714834 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-bc0abcad-4374-43d1-be58-d77a7e224014 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:50.723204 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bc0abcad-4374-43d1-be58-d77a7e224014 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:50.723772 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bc0abcad-4374-43d1-be58-d77a7e224014 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:50.724206 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bc0abcad-4374-43d1-be58-d77a7e224014 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:50.725113 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bc0abcad-4374-43d1-be58-d77a7e224014 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:50.726284 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bc0abcad-4374-43d1-be58-d77a7e224014 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:50.726639 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bc0abcad-4374-43d1-be58-d77a7e224014 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:50.731410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:50.920455 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-bc0abcad-4374-43d1-be58-d77a7e224014 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:50.928303 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-bc0abcad-4374-43d1-be58-d77a7e224014 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.220167 Nov 02 07:34:50.928905 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 343/676] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:50 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:51.720159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-59a0b86d-ad4a-4590-8aad-5ebb3d392cd9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:51.721425 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-59a0b86d-ad4a-4590-8aad-5ebb3d392cd9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:51.728630 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-59a0b86d-ad4a-4590-8aad-5ebb3d392cd9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:51.729124 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-59a0b86d-ad4a-4590-8aad-5ebb3d392cd9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:51.729558 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-59a0b86d-ad4a-4590-8aad-5ebb3d392cd9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:51.730265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-59a0b86d-ad4a-4590-8aad-5ebb3d392cd9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:51.730756 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-59a0b86d-ad4a-4590-8aad-5ebb3d392cd9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:51.731179 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-59a0b86d-ad4a-4590-8aad-5ebb3d392cd9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:51.877930 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-59a0b86d-ad4a-4590-8aad-5ebb3d392cd9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:51.886538 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-59a0b86d-ad4a-4590-8aad-5ebb3d392cd9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:51.888080 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-59a0b86d-ad4a-4590-8aad-5ebb3d392cd9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:51.889139 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-59a0b86d-ad4a-4590-8aad-5ebb3d392cd9 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1662 microversion: 2.20 time: 0.172945 Nov 02 07:34:51.889697 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 334/677] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:51 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1662 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:51.915735 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-bf9da76a-c411-47fc-b8d5-138a574fc464 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52ea7e5f-436e-4fa8-93d3-5ca56ad76692"}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:51.918332 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-bf9da76a-c411-47fc-b8d5-138a574fc464 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:51.924994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bf9da76a-c411-47fc-b8d5-138a574fc464 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:51.925475 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bf9da76a-c411-47fc-b8d5-138a574fc464 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:51.925899 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bf9da76a-c411-47fc-b8d5-138a574fc464 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:51.926715 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bf9da76a-c411-47fc-b8d5-138a574fc464 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:51.927170 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bf9da76a-c411-47fc-b8d5-138a574fc464 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:51.927607 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-bf9da76a-c411-47fc-b8d5-138a574fc464 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:51.951363 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-007b7e69-9fe7-42d8-b024-d53f54700b1a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:51.952131 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-007b7e69-9fe7-42d8-b024-d53f54700b1a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:51.959423 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-007b7e69-9fe7-42d8-b024-d53f54700b1a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:51.960677 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-007b7e69-9fe7-42d8-b024-d53f54700b1a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:51.961122 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-007b7e69-9fe7-42d8-b024-d53f54700b1a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:51.962069 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-007b7e69-9fe7-42d8-b024-d53f54700b1a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:51.962542 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-007b7e69-9fe7-42d8-b024-d53f54700b1a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:51.963185 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-007b7e69-9fe7-42d8-b024-d53f54700b1a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:52.109836 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-007b7e69-9fe7-42d8-b024-d53f54700b1a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:52.119566 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-007b7e69-9fe7-42d8-b024-d53f54700b1a tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.172298 Nov 02 07:34:52.121098 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 335/678] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:51 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:34:52.203891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-355097941", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db626555-8790-4323-a9e4-7db2e2eaf177"}], "security_groups": [{"name": "tempest-securitygroup--450577353"}], "key_name": "tempest-keypair-152485710", "user_data": "}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:52.255818 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-bf9da76a-c411-47fc-b8d5-138a574fc464 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "POST /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.344652 Nov 02 07:34:52.256541 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 344/679] 10.222.0.18 () {62 vars in 1364 bytes} [Wed Nov 2 07:34:51 2022] POST /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284/os-volume_attachments => generated 188 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 07:34:52.311507 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.network.neutron [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] validate_networks() for [('db626555-8790-4323-a9e4-7db2e2eaf177', None, None, None, None, None)] {{(pid=118992) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:34:52.386267 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-1974de61-1a6c-4420-9d0e-e7d32c1b0b15 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:52.386799 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-1974de61-1a6c-4420-9d0e-e7d32c1b0b15 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:52.393351 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1974de61-1a6c-4420-9d0e-e7d32c1b0b15 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:52.393840 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1974de61-1a6c-4420-9d0e-e7d32c1b0b15 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:52.394275 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1974de61-1a6c-4420-9d0e-e7d32c1b0b15 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:52.395001 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1974de61-1a6c-4420-9d0e-e7d32c1b0b15 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:52.395460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1974de61-1a6c-4420-9d0e-e7d32c1b0b15 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:52.395886 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1974de61-1a6c-4420-9d0e-e7d32c1b0b15 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:52.648612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-1974de61-1a6c-4420-9d0e-e7d32c1b0b15 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284/os-volume_attachments/52ea7e5f-436e-4fa8-93d3-5ca56ad76692" status: 202 len: 0 microversion: 2.20 time: 0.266172 Nov 02 07:34:52.649377 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 345/680] 10.222.0.18 () {60 vars in 1457 bytes} [Wed Nov 2 07:34:52 2022] DELETE /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284/os-volume_attachments/52ea7e5f-436e-4fa8-93d3-5ca56ad76692 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 07:34:52.713519 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2392177a-ac03-4abf-8a2f-04a660e2c480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:52.714117 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2392177a-ac03-4abf-8a2f-04a660e2c480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:52.720030 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2392177a-ac03-4abf-8a2f-04a660e2c480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:52.720513 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2392177a-ac03-4abf-8a2f-04a660e2c480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:52.720947 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2392177a-ac03-4abf-8a2f-04a660e2c480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:52.721638 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2392177a-ac03-4abf-8a2f-04a660e2c480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:52.722085 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2392177a-ac03-4abf-8a2f-04a660e2c480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:52.722542 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2392177a-ac03-4abf-8a2f-04a660e2c480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:52.739081 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Flavor limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:34:52.739605 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Image limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:34:52.740086 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Flavor pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:34:52.740512 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Image pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:34:52.740920 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:34:52.750031 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:52.750586 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:52.751018 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:52.751907 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:52.752623 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:52.753042 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:52.753352 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2392177a-ac03-4abf-8a2f-04a660e2c480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118991) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 07:34:52.770886 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Getting quotas for project ba3bab98d31d49098a8e7242d51be646. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:34:52.776028 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Getting quotas for user 47965dc7f5964bbfa4efff0822530965 and project ba3bab98d31d49098a8e7242d51be646. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:34:52.787183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Going to run 1 instances... {{(pid=118992) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:34:52.789844 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:34:52.823314 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2392177a-ac03-4abf-8a2f-04a660e2c480 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "POST /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284/action" status: 202 len: 0 microversion: 2.20 time: 0.116106 Nov 02 07:34:52.824140 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 346/681] 10.222.0.18 () {62 vars in 1319 bytes} [Wed Nov 2 07:34:52 2022] POST /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 07:34:52.832729 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f8998de8-0e9d-4bd9-ab9e-fe6101fa9a3d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:52.833635 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f8998de8-0e9d-4bd9-ab9e-fe6101fa9a3d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:52.842346 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f8998de8-0e9d-4bd9-ab9e-fe6101fa9a3d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:52.842969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f8998de8-0e9d-4bd9-ab9e-fe6101fa9a3d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:52.843510 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f8998de8-0e9d-4bd9-ab9e-fe6101fa9a3d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:52.844315 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f8998de8-0e9d-4bd9-ab9e-fe6101fa9a3d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:52.845009 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f8998de8-0e9d-4bd9-ab9e-fe6101fa9a3d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:52.845543 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f8998de8-0e9d-4bd9-ab9e-fe6101fa9a3d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:52.849484 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-68f77016-9cfb-48fa-9456-28af6c57c1ff tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.649866 Nov 02 07:34:52.857680 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 336/682] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:34:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 07:34:52.863730 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f50fc3eb-c991-4587-9e0b-5865ee217283 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:52.864471 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f50fc3eb-c991-4587-9e0b-5865ee217283 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:52.963228 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f50fc3eb-c991-4587-9e0b-5865ee217283 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:52.971023 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f50fc3eb-c991-4587-9e0b-5865ee217283 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1240 microversion: 2.1 time: 0.112185 Nov 02 07:34:52.971963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 337/683] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:52 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1240 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:34:53.058613 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f8998de8-0e9d-4bd9-ab9e-fe6101fa9a3d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:53.069860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f8998de8-0e9d-4bd9-ab9e-fe6101fa9a3d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:53.071845 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f8998de8-0e9d-4bd9-ab9e-fe6101fa9a3d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:53.073144 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f8998de8-0e9d-4bd9-ab9e-fe6101fa9a3d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1670 microversion: 2.20 time: 0.244885 Nov 02 07:34:53.073859 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 347/684] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:52 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1670 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:34:53.142898 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f9555def-a4d9-4fe0-81b0-c3b558bb97f8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:53.143797 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f9555def-a4d9-4fe0-81b0-c3b558bb97f8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:53.150013 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9555def-a4d9-4fe0-81b0-c3b558bb97f8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:53.150702 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9555def-a4d9-4fe0-81b0-c3b558bb97f8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:53.151313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9555def-a4d9-4fe0-81b0-c3b558bb97f8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:53.152171 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9555def-a4d9-4fe0-81b0-c3b558bb97f8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:53.152771 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9555def-a4d9-4fe0-81b0-c3b558bb97f8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:53.153335 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9555def-a4d9-4fe0-81b0-c3b558bb97f8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:53.347373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f9555def-a4d9-4fe0-81b0-c3b558bb97f8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:53.359687 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f9555def-a4d9-4fe0-81b0-c3b558bb97f8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.220396 Nov 02 07:34:53.361192 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 338/685] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:53 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:53.998967 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-dea4ab2d-58bc-493a-95fa-ab6e7bb91b7e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:53.999574 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-dea4ab2d-58bc-493a-95fa-ab6e7bb91b7e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:54.007391 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dea4ab2d-58bc-493a-95fa-ab6e7bb91b7e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:54.008107 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dea4ab2d-58bc-493a-95fa-ab6e7bb91b7e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:54.008535 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dea4ab2d-58bc-493a-95fa-ab6e7bb91b7e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:54.009395 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dea4ab2d-58bc-493a-95fa-ab6e7bb91b7e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:54.009879 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dea4ab2d-58bc-493a-95fa-ab6e7bb91b7e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:54.010271 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dea4ab2d-58bc-493a-95fa-ab6e7bb91b7e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:54.095347 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-dea4ab2d-58bc-493a-95fa-ab6e7bb91b7e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:54.100025 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-af992de1-5fa1-4c48-a4df-0d2a6ce79cd2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:54.101121 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-af992de1-5fa1-4c48-a4df-0d2a6ce79cd2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:54.104159 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-dea4ab2d-58bc-493a-95fa-ab6e7bb91b7e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1292 microversion: 2.1 time: 0.108999 Nov 02 07:34:54.105030 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 348/686] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:53 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1292 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:54.107951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af992de1-5fa1-4c48-a4df-0d2a6ce79cd2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:54.109223 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af992de1-5fa1-4c48-a4df-0d2a6ce79cd2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:54.109662 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af992de1-5fa1-4c48-a4df-0d2a6ce79cd2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:54.110544 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af992de1-5fa1-4c48-a4df-0d2a6ce79cd2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:54.110998 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af992de1-5fa1-4c48-a4df-0d2a6ce79cd2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:54.111453 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af992de1-5fa1-4c48-a4df-0d2a6ce79cd2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:54.259501 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-af992de1-5fa1-4c48-a4df-0d2a6ce79cd2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:54.271334 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-af992de1-5fa1-4c48-a4df-0d2a6ce79cd2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:54.274435 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-af992de1-5fa1-4c48-a4df-0d2a6ce79cd2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:54.275593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-af992de1-5fa1-4c48-a4df-0d2a6ce79cd2 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1672 microversion: 2.20 time: 0.179447 Nov 02 07:34:54.276160 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 339/687] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:54 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1672 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:34:54.385486 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8145524f-8d19-40cb-8ec1-6ee373233f6e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:54.386094 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8145524f-8d19-40cb-8ec1-6ee373233f6e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:54.392749 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8145524f-8d19-40cb-8ec1-6ee373233f6e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:54.394011 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8145524f-8d19-40cb-8ec1-6ee373233f6e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:54.394645 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8145524f-8d19-40cb-8ec1-6ee373233f6e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:54.395751 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8145524f-8d19-40cb-8ec1-6ee373233f6e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:54.396399 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8145524f-8d19-40cb-8ec1-6ee373233f6e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:54.397982 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8145524f-8d19-40cb-8ec1-6ee373233f6e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:54.593608 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8145524f-8d19-40cb-8ec1-6ee373233f6e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:54.606064 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8145524f-8d19-40cb-8ec1-6ee373233f6e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.224914 Nov 02 07:34:54.607264 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 349/688] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:54 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:55.130241 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c88a478c-e38a-4784-88be-9e2882cbacdb tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:55.131004 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c88a478c-e38a-4784-88be-9e2882cbacdb tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:55.134839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:55.139075 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c88a478c-e38a-4784-88be-9e2882cbacdb tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:55.139848 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c88a478c-e38a-4784-88be-9e2882cbacdb tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:55.140479 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c88a478c-e38a-4784-88be-9e2882cbacdb tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:55.141173 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c88a478c-e38a-4784-88be-9e2882cbacdb tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:55.141853 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c88a478c-e38a-4784-88be-9e2882cbacdb tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:55.142447 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c88a478c-e38a-4784-88be-9e2882cbacdb tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:55.302764 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b00cba1b-1056-40c2-b118-a0a1e5b8f9ac tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:55.303518 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b00cba1b-1056-40c2-b118-a0a1e5b8f9ac tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:55.314116 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b00cba1b-1056-40c2-b118-a0a1e5b8f9ac tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:55.314547 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b00cba1b-1056-40c2-b118-a0a1e5b8f9ac tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:55.314980 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b00cba1b-1056-40c2-b118-a0a1e5b8f9ac tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:55.315675 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b00cba1b-1056-40c2-b118-a0a1e5b8f9ac tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:55.316130 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b00cba1b-1056-40c2-b118-a0a1e5b8f9ac tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:55.316534 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b00cba1b-1056-40c2-b118-a0a1e5b8f9ac tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:55.426889 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c88a478c-e38a-4784-88be-9e2882cbacdb tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:55.454650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c88a478c-e38a-4784-88be-9e2882cbacdb tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1365 microversion: 2.1 time: 0.328850 Nov 02 07:34:55.455652 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 340/689] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:55 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:55.630201 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0e89a816-129a-4347-a1ee-b7db74f9b104 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:55.631272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-0e89a816-129a-4347-a1ee-b7db74f9b104 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:55.641151 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0e89a816-129a-4347-a1ee-b7db74f9b104 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:55.641151 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0e89a816-129a-4347-a1ee-b7db74f9b104 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:55.641151 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0e89a816-129a-4347-a1ee-b7db74f9b104 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:55.641151 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0e89a816-129a-4347-a1ee-b7db74f9b104 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:55.641486 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0e89a816-129a-4347-a1ee-b7db74f9b104 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:55.641486 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0e89a816-129a-4347-a1ee-b7db74f9b104 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:55.713949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b00cba1b-1056-40c2-b118-a0a1e5b8f9ac tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:55.723397 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b00cba1b-1056-40c2-b118-a0a1e5b8f9ac tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:55.725976 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b00cba1b-1056-40c2-b118-a0a1e5b8f9ac tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:55.727653 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b00cba1b-1056-40c2-b118-a0a1e5b8f9ac tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.428854 Nov 02 07:34:55.739271 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 350/690] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:55 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:34:55.899453 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-0e89a816-129a-4347-a1ee-b7db74f9b104 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:55.907478 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-0e89a816-129a-4347-a1ee-b7db74f9b104 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.281193 Nov 02 07:34:55.908591 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 341/691] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:55 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:56.265558 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-88e9473b-f9d0-40e4-ae6b-22bbf56230f0 req-de4299d8-5de4-4739-902d-65fef01412f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d", "tag": "ad23ba36-b704-412e-8ee2-7d9ab9ce9ee2"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:34:56.277809 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-88e9473b-f9d0-40e4-ae6b-22bbf56230f0 req-de4299d8-5de4-4739-902d-65fef01412f7 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:56.278747 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-88e9473b-f9d0-40e4-ae6b-22bbf56230f0 req-de4299d8-5de4-4739-902d-65fef01412f7 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:56.279417 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-88e9473b-f9d0-40e4-ae6b-22bbf56230f0 req-de4299d8-5de4-4739-902d-65fef01412f7 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:56.295473 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-88e9473b-f9d0-40e4-ae6b-22bbf56230f0 req-de4299d8-5de4-4739-902d-65fef01412f7 service nova] Creating event network-changed:ad23ba36-b704-412e-8ee2-7d9ab9ce9ee2 for instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d on hv-cinder-80473 Nov 02 07:34:56.303270 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-88e9473b-f9d0-40e4-ae6b-22bbf56230f0 req-de4299d8-5de4-4739-902d-65fef01412f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237407 Nov 02 07:34:56.305559 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 351/692] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:34:56.482767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-66a9557f-bbf2-4502-81bf-5daa1397e76a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:56.483385 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-66a9557f-bbf2-4502-81bf-5daa1397e76a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:56.490267 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-66a9557f-bbf2-4502-81bf-5daa1397e76a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:56.491115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-66a9557f-bbf2-4502-81bf-5daa1397e76a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:56.492513 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-66a9557f-bbf2-4502-81bf-5daa1397e76a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:56.493629 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-66a9557f-bbf2-4502-81bf-5daa1397e76a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:56.494081 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-66a9557f-bbf2-4502-81bf-5daa1397e76a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:56.494767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-66a9557f-bbf2-4502-81bf-5daa1397e76a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:56.631677 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-66a9557f-bbf2-4502-81bf-5daa1397e76a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:56.640463 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-66a9557f-bbf2-4502-81bf-5daa1397e76a tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1365 microversion: 2.1 time: 0.161883 Nov 02 07:34:56.653470 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 342/693] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:56 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:56.757332 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b5ff365e-b6e5-4122-9ec2-8ea09133e5d3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:56.763377 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b5ff365e-b6e5-4122-9ec2-8ea09133e5d3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:56.776754 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b5ff365e-b6e5-4122-9ec2-8ea09133e5d3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:56.777596 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b5ff365e-b6e5-4122-9ec2-8ea09133e5d3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:56.778427 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b5ff365e-b6e5-4122-9ec2-8ea09133e5d3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:56.779383 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b5ff365e-b6e5-4122-9ec2-8ea09133e5d3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:56.780252 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b5ff365e-b6e5-4122-9ec2-8ea09133e5d3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:56.780993 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b5ff365e-b6e5-4122-9ec2-8ea09133e5d3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:56.936685 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9d88048d-cda7-42ed-bf92-897d285bd348 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:56.939000 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9d88048d-cda7-42ed-bf92-897d285bd348 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:56.941185 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b5ff365e-b6e5-4122-9ec2-8ea09133e5d3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:56.946107 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9d88048d-cda7-42ed-bf92-897d285bd348 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:56.946635 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9d88048d-cda7-42ed-bf92-897d285bd348 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:56.947071 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9d88048d-cda7-42ed-bf92-897d285bd348 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:56.947782 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9d88048d-cda7-42ed-bf92-897d285bd348 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:56.948237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9d88048d-cda7-42ed-bf92-897d285bd348 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:56.948665 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9d88048d-cda7-42ed-bf92-897d285bd348 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:56.955834 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b5ff365e-b6e5-4122-9ec2-8ea09133e5d3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:56.958526 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b5ff365e-b6e5-4122-9ec2-8ea09133e5d3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:56.960981 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b5ff365e-b6e5-4122-9ec2-8ea09133e5d3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.208602 Nov 02 07:34:56.962114 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 352/694] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:56 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:57.094842 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9d88048d-cda7-42ed-bf92-897d285bd348 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:57.104430 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9d88048d-cda7-42ed-bf92-897d285bd348 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.175293 Nov 02 07:34:57.105184 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 343/695] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:56 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:34:57.664872 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f53bd505-f1d0-4737-b354-1a3e2da2d7fa tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:57.665576 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f53bd505-f1d0-4737-b354-1a3e2da2d7fa tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:57.672602 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f53bd505-f1d0-4737-b354-1a3e2da2d7fa tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:57.673225 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f53bd505-f1d0-4737-b354-1a3e2da2d7fa tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:57.673659 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f53bd505-f1d0-4737-b354-1a3e2da2d7fa tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:57.674375 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f53bd505-f1d0-4737-b354-1a3e2da2d7fa tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:57.674827 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f53bd505-f1d0-4737-b354-1a3e2da2d7fa tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:57.675456 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f53bd505-f1d0-4737-b354-1a3e2da2d7fa tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:57.863328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f53bd505-f1d0-4737-b354-1a3e2da2d7fa tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:57.873176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f53bd505-f1d0-4737-b354-1a3e2da2d7fa tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1365 microversion: 2.1 time: 0.212770 Nov 02 07:34:57.874228 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 353/696] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:57 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:34:57.987178 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a50debcd-7e70-44c0-a2b3-ba103fb790fb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:57.987808 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a50debcd-7e70-44c0-a2b3-ba103fb790fb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:57.994795 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a50debcd-7e70-44c0-a2b3-ba103fb790fb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:57.995272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a50debcd-7e70-44c0-a2b3-ba103fb790fb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:57.995705 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a50debcd-7e70-44c0-a2b3-ba103fb790fb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:57.996386 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a50debcd-7e70-44c0-a2b3-ba103fb790fb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:57.996841 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a50debcd-7e70-44c0-a2b3-ba103fb790fb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:57.997250 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a50debcd-7e70-44c0-a2b3-ba103fb790fb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:58.128798 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-35253788-f1c8-4655-87c1-05c1ef52ac5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:58.129546 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-35253788-f1c8-4655-87c1-05c1ef52ac5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:58.136059 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-35253788-f1c8-4655-87c1-05c1ef52ac5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:58.136542 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-35253788-f1c8-4655-87c1-05c1ef52ac5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:58.136790 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a50debcd-7e70-44c0-a2b3-ba103fb790fb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:58.136964 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-35253788-f1c8-4655-87c1-05c1ef52ac5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:58.137843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-35253788-f1c8-4655-87c1-05c1ef52ac5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:58.138287 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-35253788-f1c8-4655-87c1-05c1ef52ac5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:58.138735 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-35253788-f1c8-4655-87c1-05c1ef52ac5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:58.145634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a50debcd-7e70-44c0-a2b3-ba103fb790fb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:58.148062 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a50debcd-7e70-44c0-a2b3-ba103fb790fb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:58.149666 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a50debcd-7e70-44c0-a2b3-ba103fb790fb tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.166464 Nov 02 07:34:58.155029 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:58.155354 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 344/697] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:57 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:58.276934 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-35253788-f1c8-4655-87c1-05c1ef52ac5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:58.284636 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-35253788-f1c8-4655-87c1-05c1ef52ac5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.159952 Nov 02 07:34:58.285377 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 354/698] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:58 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:34:58.901056 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a40c0d2a-b04e-4008-ac05-868d570795b5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:58.901734 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a40c0d2a-b04e-4008-ac05-868d570795b5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:58.910766 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a40c0d2a-b04e-4008-ac05-868d570795b5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:58.910766 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a40c0d2a-b04e-4008-ac05-868d570795b5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:58.911141 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a40c0d2a-b04e-4008-ac05-868d570795b5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:58.911948 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a40c0d2a-b04e-4008-ac05-868d570795b5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:58.912449 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a40c0d2a-b04e-4008-ac05-868d570795b5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:58.912836 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a40c0d2a-b04e-4008-ac05-868d570795b5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:59.113250 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a40c0d2a-b04e-4008-ac05-868d570795b5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:59.121789 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a40c0d2a-b04e-4008-ac05-868d570795b5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1365 microversion: 2.1 time: 0.225714 Nov 02 07:34:59.122475 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 345/699] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:58 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:34:59.180269 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-9547912c-b2a5-41e0-b396-a57652d2d4fa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:59.180813 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-9547912c-b2a5-41e0-b396-a57652d2d4fa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:59.188489 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9547912c-b2a5-41e0-b396-a57652d2d4fa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:59.188970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9547912c-b2a5-41e0-b396-a57652d2d4fa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:59.189949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9547912c-b2a5-41e0-b396-a57652d2d4fa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:59.191030 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9547912c-b2a5-41e0-b396-a57652d2d4fa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:59.191483 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9547912c-b2a5-41e0-b396-a57652d2d4fa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:59.191905 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9547912c-b2a5-41e0-b396-a57652d2d4fa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:59.309809 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-b400fbe2-0bb5-45c0-9796-463544dfb35f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:34:59.310467 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-b400fbe2-0bb5-45c0-9796-463544dfb35f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:34:59.324522 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b400fbe2-0bb5-45c0-9796-463544dfb35f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:59.325406 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b400fbe2-0bb5-45c0-9796-463544dfb35f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:59.327532 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b400fbe2-0bb5-45c0-9796-463544dfb35f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:59.329199 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b400fbe2-0bb5-45c0-9796-463544dfb35f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:34:59.329666 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b400fbe2-0bb5-45c0-9796-463544dfb35f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:34:59.330096 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b400fbe2-0bb5-45c0-9796-463544dfb35f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:34:59.517117 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-9547912c-b2a5-41e0-b396-a57652d2d4fa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:59.528202 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-9547912c-b2a5-41e0-b396-a57652d2d4fa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:59.530305 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-9547912c-b2a5-41e0-b396-a57652d2d4fa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:59.532114 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-9547912c-b2a5-41e0-b396-a57652d2d4fa tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.357125 Nov 02 07:34:59.532998 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 355/700] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:34:59 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:34:59.563495 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-b400fbe2-0bb5-45c0-9796-463544dfb35f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:34:59.572646 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-b400fbe2-0bb5-45c0-9796-463544dfb35f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.267576 Nov 02 07:34:59.573582 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 346/701] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:34:59 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:35:00.145324 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-fa393737-af13-4484-9666-849c0485bbc6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:00.145867 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-fa393737-af13-4484-9666-849c0485bbc6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:00.152932 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fa393737-af13-4484-9666-849c0485bbc6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:00.153411 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fa393737-af13-4484-9666-849c0485bbc6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:00.153844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fa393737-af13-4484-9666-849c0485bbc6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:00.154586 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fa393737-af13-4484-9666-849c0485bbc6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:00.155044 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fa393737-af13-4484-9666-849c0485bbc6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:00.155468 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fa393737-af13-4484-9666-849c0485bbc6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:00.312669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-fa393737-af13-4484-9666-849c0485bbc6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:00.321571 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-fa393737-af13-4484-9666-849c0485bbc6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1365 microversion: 2.1 time: 0.180097 Nov 02 07:35:00.322154 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 356/702] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:00 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:00.517739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-cdbd57fc-5807-4114-925c-7dd1383ae7b7 req-cb306df0-d856-4cd8-ac7f-8f9b8012338b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d", "name": "network-vif-plugged", "status": "completed", "tag": "ad23ba36-b704-412e-8ee2-7d9ab9ce9ee2"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:35:00.528845 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-cdbd57fc-5807-4114-925c-7dd1383ae7b7 req-cb306df0-d856-4cd8-ac7f-8f9b8012338b service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:00.529347 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-cdbd57fc-5807-4114-925c-7dd1383ae7b7 req-cb306df0-d856-4cd8-ac7f-8f9b8012338b service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:00.529778 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-cdbd57fc-5807-4114-925c-7dd1383ae7b7 req-cb306df0-d856-4cd8-ac7f-8f9b8012338b service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:00.542865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-cdbd57fc-5807-4114-925c-7dd1383ae7b7 req-cb306df0-d856-4cd8-ac7f-8f9b8012338b service nova] Creating event network-vif-plugged:ad23ba36-b704-412e-8ee2-7d9ab9ce9ee2 for instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d on hv-cinder-80473 Nov 02 07:35:00.548430 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-cdbd57fc-5807-4114-925c-7dd1383ae7b7 req-cb306df0-d856-4cd8-ac7f-8f9b8012338b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202904 Nov 02 07:35:00.549663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 347/703] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:35:00.560105 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-24c622b0-1685-4dd3-9adb-815a7353c259 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:00.560744 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-24c622b0-1685-4dd3-9adb-815a7353c259 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:00.562754 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=4 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:00.568733 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24c622b0-1685-4dd3-9adb-815a7353c259 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:00.569275 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24c622b0-1685-4dd3-9adb-815a7353c259 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:00.570280 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24c622b0-1685-4dd3-9adb-815a7353c259 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:00.571075 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24c622b0-1685-4dd3-9adb-815a7353c259 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:00.571741 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24c622b0-1685-4dd3-9adb-815a7353c259 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:00.572178 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24c622b0-1685-4dd3-9adb-815a7353c259 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:00.602874 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7d53abff-3a71-406a-b827-7ba3186bd124 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:00.603578 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-7d53abff-3a71-406a-b827-7ba3186bd124 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:00.614390 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7d53abff-3a71-406a-b827-7ba3186bd124 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:00.614873 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7d53abff-3a71-406a-b827-7ba3186bd124 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:00.615308 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7d53abff-3a71-406a-b827-7ba3186bd124 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:00.616011 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7d53abff-3a71-406a-b827-7ba3186bd124 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:00.623072 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7d53abff-3a71-406a-b827-7ba3186bd124 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:00.623700 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7d53abff-3a71-406a-b827-7ba3186bd124 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:00.769488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-24c622b0-1685-4dd3-9adb-815a7353c259 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:00.792090 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-24c622b0-1685-4dd3-9adb-815a7353c259 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:00.793401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-24c622b0-1685-4dd3-9adb-815a7353c259 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:00.795546 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-24c622b0-1685-4dd3-9adb-815a7353c259 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.238674 Nov 02 07:35:00.795546 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 357/704] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:35:00 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:35:00.876224 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-7d53abff-3a71-406a-b827-7ba3186bd124 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:00.887579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-7d53abff-3a71-406a-b827-7ba3186bd124 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.289678 Nov 02 07:35:00.888925 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 348/705] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:00 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:35:01.360569 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-56a75a1d-8618-4bc4-837d-770e69649062 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:01.361164 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-56a75a1d-8618-4bc4-837d-770e69649062 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:01.368083 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-56a75a1d-8618-4bc4-837d-770e69649062 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:01.368927 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-56a75a1d-8618-4bc4-837d-770e69649062 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:01.369585 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-56a75a1d-8618-4bc4-837d-770e69649062 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:01.370721 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-56a75a1d-8618-4bc4-837d-770e69649062 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:01.371242 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-56a75a1d-8618-4bc4-837d-770e69649062 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:01.371958 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-56a75a1d-8618-4bc4-837d-770e69649062 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:01.528931 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-56a75a1d-8618-4bc4-837d-770e69649062 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:01.538620 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-56a75a1d-8618-4bc4-837d-770e69649062 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1365 microversion: 2.1 time: 0.181685 Nov 02 07:35:01.541786 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 358/706] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:01 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:01.819785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2b05ef24-efe0-45eb-b8da-0452fdd0cebf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:01.821072 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-2b05ef24-efe0-45eb-b8da-0452fdd0cebf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:01.827506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b05ef24-efe0-45eb-b8da-0452fdd0cebf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:01.827986 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b05ef24-efe0-45eb-b8da-0452fdd0cebf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:01.828416 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b05ef24-efe0-45eb-b8da-0452fdd0cebf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:01.829102 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b05ef24-efe0-45eb-b8da-0452fdd0cebf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:01.829551 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b05ef24-efe0-45eb-b8da-0452fdd0cebf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:01.829972 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b05ef24-efe0-45eb-b8da-0452fdd0cebf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:01.915296 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5a3b3329-a2dd-4809-9f86-18145b93bdb6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:01.915842 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-5a3b3329-a2dd-4809-9f86-18145b93bdb6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:01.931391 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5a3b3329-a2dd-4809-9f86-18145b93bdb6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:01.931885 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5a3b3329-a2dd-4809-9f86-18145b93bdb6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:01.932321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5a3b3329-a2dd-4809-9f86-18145b93bdb6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:01.933042 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5a3b3329-a2dd-4809-9f86-18145b93bdb6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:01.933494 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5a3b3329-a2dd-4809-9f86-18145b93bdb6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:01.934041 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5a3b3329-a2dd-4809-9f86-18145b93bdb6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:01.985044 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2b05ef24-efe0-45eb-b8da-0452fdd0cebf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:01.993761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2b05ef24-efe0-45eb-b8da-0452fdd0cebf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:01.995364 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2b05ef24-efe0-45eb-b8da-0452fdd0cebf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:01.996683 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-2b05ef24-efe0-45eb-b8da-0452fdd0cebf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.180797 Nov 02 07:35:01.997577 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 349/707] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:35:01 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:35:02.103205 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-5a3b3329-a2dd-4809-9f86-18145b93bdb6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:02.111207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-5a3b3329-a2dd-4809-9f86-18145b93bdb6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.201666 Nov 02 07:35:02.111776 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 359/708] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:01 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:02.563362 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-557d62ad-05a7-4293-aff4-643646e5a78c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:02.563967 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-557d62ad-05a7-4293-aff4-643646e5a78c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:02.570329 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-557d62ad-05a7-4293-aff4-643646e5a78c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:02.570925 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-557d62ad-05a7-4293-aff4-643646e5a78c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:02.571359 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-557d62ad-05a7-4293-aff4-643646e5a78c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:02.572051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-557d62ad-05a7-4293-aff4-643646e5a78c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:02.572500 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-557d62ad-05a7-4293-aff4-643646e5a78c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:02.572921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-557d62ad-05a7-4293-aff4-643646e5a78c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:02.726557 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-557d62ad-05a7-4293-aff4-643646e5a78c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:02.730122 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=100 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:02.735308 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-557d62ad-05a7-4293-aff4-643646e5a78c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1365 microversion: 2.1 time: 0.176329 Nov 02 07:35:02.735875 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 350/709] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:02 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:35:03.032212 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-20b02ce5-16e2-49da-84b3-e955c1fdb08e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:03.033578 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-20b02ce5-16e2-49da-84b3-e955c1fdb08e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:03.041428 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-20b02ce5-16e2-49da-84b3-e955c1fdb08e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:03.042191 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-20b02ce5-16e2-49da-84b3-e955c1fdb08e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:03.042818 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-20b02ce5-16e2-49da-84b3-e955c1fdb08e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:03.043695 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-20b02ce5-16e2-49da-84b3-e955c1fdb08e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:03.044310 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-20b02ce5-16e2-49da-84b3-e955c1fdb08e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:03.044896 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-20b02ce5-16e2-49da-84b3-e955c1fdb08e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:03.137086 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0307adda-e059-40dc-b5ba-7a37afa8c19b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:03.138467 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-0307adda-e059-40dc-b5ba-7a37afa8c19b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:03.144440 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:03.147613 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=8 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:03.155258 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0307adda-e059-40dc-b5ba-7a37afa8c19b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:03.156100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0307adda-e059-40dc-b5ba-7a37afa8c19b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:03.156782 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0307adda-e059-40dc-b5ba-7a37afa8c19b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:03.157727 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0307adda-e059-40dc-b5ba-7a37afa8c19b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:03.158415 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0307adda-e059-40dc-b5ba-7a37afa8c19b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:03.159053 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0307adda-e059-40dc-b5ba-7a37afa8c19b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:03.192140 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-20b02ce5-16e2-49da-84b3-e955c1fdb08e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:03.203725 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-20b02ce5-16e2-49da-84b3-e955c1fdb08e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:03.206007 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-20b02ce5-16e2-49da-84b3-e955c1fdb08e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:03.207404 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-20b02ce5-16e2-49da-84b3-e955c1fdb08e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.179076 Nov 02 07:35:03.223055 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 360/710] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:35:03 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:35:03.308832 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-0307adda-e059-40dc-b5ba-7a37afa8c19b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:03.316485 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-0307adda-e059-40dc-b5ba-7a37afa8c19b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.185176 Nov 02 07:35:03.317052 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 351/711] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:03 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:03.759660 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-39bf08a1-f076-4db0-a32e-f29040336c87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:03.760316 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-39bf08a1-f076-4db0-a32e-f29040336c87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:03.762340 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:03.767410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-39bf08a1-f076-4db0-a32e-f29040336c87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:03.767889 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-39bf08a1-f076-4db0-a32e-f29040336c87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:03.768553 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-39bf08a1-f076-4db0-a32e-f29040336c87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:03.769248 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-39bf08a1-f076-4db0-a32e-f29040336c87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:03.769694 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-39bf08a1-f076-4db0-a32e-f29040336c87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:03.770113 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-39bf08a1-f076-4db0-a32e-f29040336c87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:03.909469 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-39bf08a1-f076-4db0-a32e-f29040336c87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:03.917465 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-39bf08a1-f076-4db0-a32e-f29040336c87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1365 microversion: 2.1 time: 0.161711 Nov 02 07:35:03.918261 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 361/712] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:03 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:04.236142 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-36f0079e-f7c0-4f14-88b3-d9577c97669f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:04.236751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-36f0079e-f7c0-4f14-88b3-d9577c97669f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:04.244949 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-36f0079e-f7c0-4f14-88b3-d9577c97669f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:04.245437 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-36f0079e-f7c0-4f14-88b3-d9577c97669f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:04.246056 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-36f0079e-f7c0-4f14-88b3-d9577c97669f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:04.246849 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-36f0079e-f7c0-4f14-88b3-d9577c97669f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:04.247297 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-36f0079e-f7c0-4f14-88b3-d9577c97669f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:04.247906 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-36f0079e-f7c0-4f14-88b3-d9577c97669f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:04.343394 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a34c3a36-4d0a-48a8-9b3f-b453dd6b1779 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:04.344930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a34c3a36-4d0a-48a8-9b3f-b453dd6b1779 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:04.363243 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a34c3a36-4d0a-48a8-9b3f-b453dd6b1779 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:04.363738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a34c3a36-4d0a-48a8-9b3f-b453dd6b1779 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:04.364172 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a34c3a36-4d0a-48a8-9b3f-b453dd6b1779 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:04.368277 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a34c3a36-4d0a-48a8-9b3f-b453dd6b1779 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:04.368724 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a34c3a36-4d0a-48a8-9b3f-b453dd6b1779 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:04.370225 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a34c3a36-4d0a-48a8-9b3f-b453dd6b1779 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:04.425848 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-36f0079e-f7c0-4f14-88b3-d9577c97669f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:04.435254 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-36f0079e-f7c0-4f14-88b3-d9577c97669f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:04.436915 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-36f0079e-f7c0-4f14-88b3-d9577c97669f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:04.438079 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-36f0079e-f7c0-4f14-88b3-d9577c97669f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.206250 Nov 02 07:35:04.438987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 352/713] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:35:04 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:35:04.577790 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a34c3a36-4d0a-48a8-9b3f-b453dd6b1779 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:04.587659 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a34c3a36-4d0a-48a8-9b3f-b453dd6b1779 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.250423 Nov 02 07:35:04.589048 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 362/714] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:04 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:04.947789 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ce63812e-aaaf-42dd-ab53-11b144da4408 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:04.949050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ce63812e-aaaf-42dd-ab53-11b144da4408 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:04.957407 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ce63812e-aaaf-42dd-ab53-11b144da4408 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:04.958696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ce63812e-aaaf-42dd-ab53-11b144da4408 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:04.959432 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ce63812e-aaaf-42dd-ab53-11b144da4408 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:04.960994 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ce63812e-aaaf-42dd-ab53-11b144da4408 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:04.962058 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ce63812e-aaaf-42dd-ab53-11b144da4408 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:04.962908 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ce63812e-aaaf-42dd-ab53-11b144da4408 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:05.177103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ce63812e-aaaf-42dd-ab53-11b144da4408 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:05.186714 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ce63812e-aaaf-42dd-ab53-11b144da4408 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1365 microversion: 2.1 time: 0.245882 Nov 02 07:35:05.187589 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 353/715] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:04 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:05.465569 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2cd51138-6e4a-4086-839b-a2ca89af4b41 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:05.466955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2cd51138-6e4a-4086-839b-a2ca89af4b41 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:05.473779 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2cd51138-6e4a-4086-839b-a2ca89af4b41 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:05.474510 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2cd51138-6e4a-4086-839b-a2ca89af4b41 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:05.475101 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2cd51138-6e4a-4086-839b-a2ca89af4b41 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:05.476090 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2cd51138-6e4a-4086-839b-a2ca89af4b41 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:05.476880 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2cd51138-6e4a-4086-839b-a2ca89af4b41 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:05.477725 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2cd51138-6e4a-4086-839b-a2ca89af4b41 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:05.612639 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e2573fa4-8ce2-4a25-83d4-0145600f87c0 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:05.613952 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e2573fa4-8ce2-4a25-83d4-0145600f87c0 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:05.622241 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2cd51138-6e4a-4086-839b-a2ca89af4b41 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:05.623617 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e2573fa4-8ce2-4a25-83d4-0145600f87c0 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:05.627369 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e2573fa4-8ce2-4a25-83d4-0145600f87c0 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:05.628531 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e2573fa4-8ce2-4a25-83d4-0145600f87c0 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:05.629455 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e2573fa4-8ce2-4a25-83d4-0145600f87c0 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:05.630584 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e2573fa4-8ce2-4a25-83d4-0145600f87c0 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:05.633225 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2cd51138-6e4a-4086-839b-a2ca89af4b41 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:05.634965 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2cd51138-6e4a-4086-839b-a2ca89af4b41 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:05.636177 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e2573fa4-8ce2-4a25-83d4-0145600f87c0 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:05.636641 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2cd51138-6e4a-4086-839b-a2ca89af4b41 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.174929 Nov 02 07:35:05.637423 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 363/716] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:35:05 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:35:05.817819 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-e2573fa4-8ce2-4a25-83d4-0145600f87c0 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:05.826619 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e2573fa4-8ce2-4a25-83d4-0145600f87c0 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.217829 Nov 02 07:35:05.827290 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 354/717] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:05 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:35:06.214788 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2362404b-9f13-4538-b4d7-0280cfcb11d6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:06.215408 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2362404b-9f13-4538-b4d7-0280cfcb11d6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:06.224999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2362404b-9f13-4538-b4d7-0280cfcb11d6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:06.227467 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2362404b-9f13-4538-b4d7-0280cfcb11d6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:06.228291 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2362404b-9f13-4538-b4d7-0280cfcb11d6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:06.230079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2362404b-9f13-4538-b4d7-0280cfcb11d6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:06.230593 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2362404b-9f13-4538-b4d7-0280cfcb11d6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:06.231311 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2362404b-9f13-4538-b4d7-0280cfcb11d6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:06.371911 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2362404b-9f13-4538-b4d7-0280cfcb11d6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:06.380607 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2362404b-9f13-4538-b4d7-0280cfcb11d6 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1365 microversion: 2.1 time: 0.170220 Nov 02 07:35:06.381449 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 364/718] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:06 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:06.665158 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-25b542ff-02f9-453d-a378-10ffda9b922e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:06.665796 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-25b542ff-02f9-453d-a378-10ffda9b922e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:06.671568 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-25b542ff-02f9-453d-a378-10ffda9b922e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:06.672044 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-25b542ff-02f9-453d-a378-10ffda9b922e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:06.672465 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-25b542ff-02f9-453d-a378-10ffda9b922e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:06.673149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-25b542ff-02f9-453d-a378-10ffda9b922e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:06.673592 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-25b542ff-02f9-453d-a378-10ffda9b922e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:06.674009 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-25b542ff-02f9-453d-a378-10ffda9b922e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:06.842790 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-25b542ff-02f9-453d-a378-10ffda9b922e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:06.852246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-cc53fa79-b62e-490d-9242-be8e71a47dad tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:06.852923 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-cc53fa79-b62e-490d-9242-be8e71a47dad tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:06.853185 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-25b542ff-02f9-453d-a378-10ffda9b922e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:06.854624 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-25b542ff-02f9-453d-a378-10ffda9b922e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:06.855776 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-25b542ff-02f9-453d-a378-10ffda9b922e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.195425 Nov 02 07:35:06.856322 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 355/719] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:35:06 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:35:06.860207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cc53fa79-b62e-490d-9242-be8e71a47dad tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:06.860759 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cc53fa79-b62e-490d-9242-be8e71a47dad tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:06.861981 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cc53fa79-b62e-490d-9242-be8e71a47dad tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:06.862778 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cc53fa79-b62e-490d-9242-be8e71a47dad tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:06.863441 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cc53fa79-b62e-490d-9242-be8e71a47dad tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:06.863955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cc53fa79-b62e-490d-9242-be8e71a47dad tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:07.018557 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-cc53fa79-b62e-490d-9242-be8e71a47dad tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:07.026991 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-cc53fa79-b62e-490d-9242-be8e71a47dad tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.179662 Nov 02 07:35:07.027534 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 365/720] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:06 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:07.404907 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3f7767ba-6c48-4214-9505-2f76418b381f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:07.405518 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3f7767ba-6c48-4214-9505-2f76418b381f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:07.411495 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3f7767ba-6c48-4214-9505-2f76418b381f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:07.411979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3f7767ba-6c48-4214-9505-2f76418b381f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:07.412414 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3f7767ba-6c48-4214-9505-2f76418b381f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:07.413107 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3f7767ba-6c48-4214-9505-2f76418b381f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:07.413834 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3f7767ba-6c48-4214-9505-2f76418b381f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:07.414231 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3f7767ba-6c48-4214-9505-2f76418b381f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:07.544436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3f7767ba-6c48-4214-9505-2f76418b381f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:07.552758 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3f7767ba-6c48-4214-9505-2f76418b381f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1365 microversion: 2.1 time: 0.151803 Nov 02 07:35:07.553397 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 356/721] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:07 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:07.881317 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8acf33fb-fc39-47b6-a70d-0d9c1cbdab0d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:07.881976 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8acf33fb-fc39-47b6-a70d-0d9c1cbdab0d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:07.888795 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8acf33fb-fc39-47b6-a70d-0d9c1cbdab0d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:07.889275 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8acf33fb-fc39-47b6-a70d-0d9c1cbdab0d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:07.889723 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8acf33fb-fc39-47b6-a70d-0d9c1cbdab0d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:07.890499 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8acf33fb-fc39-47b6-a70d-0d9c1cbdab0d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:07.890976 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8acf33fb-fc39-47b6-a70d-0d9c1cbdab0d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:07.891643 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8acf33fb-fc39-47b6-a70d-0d9c1cbdab0d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:08.024438 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8acf33fb-fc39-47b6-a70d-0d9c1cbdab0d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:08.032911 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8acf33fb-fc39-47b6-a70d-0d9c1cbdab0d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:08.034335 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8acf33fb-fc39-47b6-a70d-0d9c1cbdab0d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:08.035510 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8acf33fb-fc39-47b6-a70d-0d9c1cbdab0d tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.158363 Nov 02 07:35:08.036065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 366/722] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:35:07 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:35:08.051095 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a32da9b7-250c-402e-8ed9-c8d1675db66c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:08.051694 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a32da9b7-250c-402e-8ed9-c8d1675db66c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:08.058832 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a32da9b7-250c-402e-8ed9-c8d1675db66c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:08.059308 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a32da9b7-250c-402e-8ed9-c8d1675db66c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:08.059732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a32da9b7-250c-402e-8ed9-c8d1675db66c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:08.060411 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a32da9b7-250c-402e-8ed9-c8d1675db66c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:08.060857 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a32da9b7-250c-402e-8ed9-c8d1675db66c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:08.061278 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a32da9b7-250c-402e-8ed9-c8d1675db66c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:08.205699 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a32da9b7-250c-402e-8ed9-c8d1675db66c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:08.214315 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a32da9b7-250c-402e-8ed9-c8d1675db66c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.167037 Nov 02 07:35:08.214910 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 357/723] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:08 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:08.576996 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f4f789c3-23ee-4129-a12f-3ba0a9146901 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:08.577733 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f4f789c3-23ee-4129-a12f-3ba0a9146901 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:08.584253 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f4f789c3-23ee-4129-a12f-3ba0a9146901 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:08.584742 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f4f789c3-23ee-4129-a12f-3ba0a9146901 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:08.585191 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f4f789c3-23ee-4129-a12f-3ba0a9146901 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:08.585888 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f4f789c3-23ee-4129-a12f-3ba0a9146901 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:08.586328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f4f789c3-23ee-4129-a12f-3ba0a9146901 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:08.586778 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f4f789c3-23ee-4129-a12f-3ba0a9146901 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:08.789721 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f4f789c3-23ee-4129-a12f-3ba0a9146901 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:08.798057 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f4f789c3-23ee-4129-a12f-3ba0a9146901 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1365 microversion: 2.1 time: 0.224908 Nov 02 07:35:08.798801 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 367/724] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:08 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:09.063912 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-bec8f0d9-f522-4760-8b5f-449b8cb4dbdf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:09.064606 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-bec8f0d9-f522-4760-8b5f-449b8cb4dbdf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:09.072511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bec8f0d9-f522-4760-8b5f-449b8cb4dbdf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:09.073060 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bec8f0d9-f522-4760-8b5f-449b8cb4dbdf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:09.073537 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bec8f0d9-f522-4760-8b5f-449b8cb4dbdf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:09.074287 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bec8f0d9-f522-4760-8b5f-449b8cb4dbdf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:09.074829 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bec8f0d9-f522-4760-8b5f-449b8cb4dbdf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:09.075311 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bec8f0d9-f522-4760-8b5f-449b8cb4dbdf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:09.210721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-bec8f0d9-f522-4760-8b5f-449b8cb4dbdf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:09.219485 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-bec8f0d9-f522-4760-8b5f-449b8cb4dbdf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:09.220905 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-bec8f0d9-f522-4760-8b5f-449b8cb4dbdf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:09.222089 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-bec8f0d9-f522-4760-8b5f-449b8cb4dbdf tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.162064 Nov 02 07:35:09.222759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 358/725] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:35:09 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:35:09.236772 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-57eeaeff-8a61-4cf6-9030-83aa6fb053c2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:09.237507 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-57eeaeff-8a61-4cf6-9030-83aa6fb053c2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:09.244035 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-57eeaeff-8a61-4cf6-9030-83aa6fb053c2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:09.244504 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-57eeaeff-8a61-4cf6-9030-83aa6fb053c2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:09.244925 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-57eeaeff-8a61-4cf6-9030-83aa6fb053c2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:09.245595 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-57eeaeff-8a61-4cf6-9030-83aa6fb053c2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:09.246040 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-57eeaeff-8a61-4cf6-9030-83aa6fb053c2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:09.246483 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-57eeaeff-8a61-4cf6-9030-83aa6fb053c2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:09.390279 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-57eeaeff-8a61-4cf6-9030-83aa6fb053c2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:09.399141 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-57eeaeff-8a61-4cf6-9030-83aa6fb053c2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.165927 Nov 02 07:35:09.400121 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 368/726] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:09 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:09.821633 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-48cc1939-cd5e-4de9-9c36-ae9b20028777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:09.822228 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-48cc1939-cd5e-4de9-9c36-ae9b20028777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:09.828125 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-48cc1939-cd5e-4de9-9c36-ae9b20028777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:09.828604 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-48cc1939-cd5e-4de9-9c36-ae9b20028777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:09.829034 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-48cc1939-cd5e-4de9-9c36-ae9b20028777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:09.829712 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-48cc1939-cd5e-4de9-9c36-ae9b20028777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:09.830170 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-48cc1939-cd5e-4de9-9c36-ae9b20028777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:09.830605 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-48cc1939-cd5e-4de9-9c36-ae9b20028777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:09.964989 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-48cc1939-cd5e-4de9-9c36-ae9b20028777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:09.972572 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-48cc1939-cd5e-4de9-9c36-ae9b20028777 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1365 microversion: 2.1 time: 0.155339 Nov 02 07:35:09.973138 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 359/727] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:09 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:10.248681 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-821f3feb-ba6d-4ee9-9c58-78e721c551e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:10.249419 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-821f3feb-ba6d-4ee9-9c58-78e721c551e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:10.260716 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-821f3feb-ba6d-4ee9-9c58-78e721c551e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:10.261204 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-821f3feb-ba6d-4ee9-9c58-78e721c551e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:10.261638 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-821f3feb-ba6d-4ee9-9c58-78e721c551e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:10.262341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-821f3feb-ba6d-4ee9-9c58-78e721c551e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:10.262812 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-821f3feb-ba6d-4ee9-9c58-78e721c551e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:10.263237 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-821f3feb-ba6d-4ee9-9c58-78e721c551e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:10.405069 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-821f3feb-ba6d-4ee9-9c58-78e721c551e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:10.413879 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-821f3feb-ba6d-4ee9-9c58-78e721c551e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:10.415537 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-821f3feb-ba6d-4ee9-9c58-78e721c551e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:10.416692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-821f3feb-ba6d-4ee9-9c58-78e721c551e8 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.172152 Nov 02 07:35:10.417236 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 369/728] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:35:10 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:35:10.423340 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ca0eee40-8642-4a03-8d72-41ed6c52393b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:10.424315 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ca0eee40-8642-4a03-8d72-41ed6c52393b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:10.432901 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ca0eee40-8642-4a03-8d72-41ed6c52393b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:10.433549 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ca0eee40-8642-4a03-8d72-41ed6c52393b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:10.434109 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ca0eee40-8642-4a03-8d72-41ed6c52393b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:10.435090 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ca0eee40-8642-4a03-8d72-41ed6c52393b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:10.435619 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ca0eee40-8642-4a03-8d72-41ed6c52393b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:10.436150 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ca0eee40-8642-4a03-8d72-41ed6c52393b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:10.587498 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ca0eee40-8642-4a03-8d72-41ed6c52393b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:10.595240 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ca0eee40-8642-4a03-8d72-41ed6c52393b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.175918 Nov 02 07:35:10.595810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 360/729] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:10 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:10.996586 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-cd489311-feae-4282-854e-35df1e19aff0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:10.997195 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-cd489311-feae-4282-854e-35df1e19aff0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:11.003492 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd489311-feae-4282-854e-35df1e19aff0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:11.003907 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd489311-feae-4282-854e-35df1e19aff0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:11.004360 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd489311-feae-4282-854e-35df1e19aff0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:11.005028 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd489311-feae-4282-854e-35df1e19aff0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:11.005471 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd489311-feae-4282-854e-35df1e19aff0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:11.005886 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd489311-feae-4282-854e-35df1e19aff0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:11.136857 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-cd489311-feae-4282-854e-35df1e19aff0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:11.145088 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-cd489311-feae-4282-854e-35df1e19aff0 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1365 microversion: 2.1 time: 0.152307 Nov 02 07:35:11.145646 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 370/730] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:10 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:11.448871 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0313c8d8-cede-4131-a715-3bc826d994e4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:11.449868 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-0313c8d8-cede-4131-a715-3bc826d994e4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:11.458259 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0313c8d8-cede-4131-a715-3bc826d994e4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:11.459156 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0313c8d8-cede-4131-a715-3bc826d994e4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:11.459625 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0313c8d8-cede-4131-a715-3bc826d994e4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:11.461637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0313c8d8-cede-4131-a715-3bc826d994e4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:11.461825 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0313c8d8-cede-4131-a715-3bc826d994e4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:11.462247 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-0313c8d8-cede-4131-a715-3bc826d994e4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:11.618538 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-22376d36-09c5-498b-b858-8cc1a7e23c9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:11.619551 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-22376d36-09c5-498b-b858-8cc1a7e23c9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:11.630873 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-22376d36-09c5-498b-b858-8cc1a7e23c9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:11.631885 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-22376d36-09c5-498b-b858-8cc1a7e23c9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:11.632468 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-22376d36-09c5-498b-b858-8cc1a7e23c9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:11.633419 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-22376d36-09c5-498b-b858-8cc1a7e23c9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:11.633968 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-22376d36-09c5-498b-b858-8cc1a7e23c9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:11.634514 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-22376d36-09c5-498b-b858-8cc1a7e23c9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:11.638961 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=100 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:11.647146 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-0313c8d8-cede-4131-a715-3bc826d994e4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:11.658110 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-0313c8d8-cede-4131-a715-3bc826d994e4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:11.659601 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-0313c8d8-cede-4131-a715-3bc826d994e4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:11.660774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-0313c8d8-cede-4131-a715-3bc826d994e4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.219529 Nov 02 07:35:11.661342 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 361/731] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:35:11 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:35:11.771518 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-22376d36-09c5-498b-b858-8cc1a7e23c9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:11.781097 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-22376d36-09c5-498b-b858-8cc1a7e23c9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.166747 Nov 02 07:35:11.781666 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 371/732] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:11 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:35:12.168220 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-465a708c-da27-4d5e-b333-5f11d3457c5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:12.168830 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-465a708c-da27-4d5e-b333-5f11d3457c5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:12.174653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-465a708c-da27-4d5e-b333-5f11d3457c5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:12.175133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-465a708c-da27-4d5e-b333-5f11d3457c5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:12.175559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-465a708c-da27-4d5e-b333-5f11d3457c5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:12.176237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-465a708c-da27-4d5e-b333-5f11d3457c5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:12.176684 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-465a708c-da27-4d5e-b333-5f11d3457c5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:12.177103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-465a708c-da27-4d5e-b333-5f11d3457c5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:12.351714 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-465a708c-da27-4d5e-b333-5f11d3457c5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:12.360474 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-465a708c-da27-4d5e-b333-5f11d3457c5c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1554 microversion: 2.1 time: 0.195844 Nov 02 07:35:12.361725 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 362/733] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:12 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:12.362431 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-9e1e4789-d1db-49ec-b7bf-fdb6d2769ae3 req-ce4a3ef1-ad23-47ad-a6a8-cfe584684981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e24f861-ba20-4595-9dd5-9ea1f9832284", "name": "network-vif-plugged", "status": "completed", "tag": "9b205abf-2fab-4e5a-9b1e-0110c74b9f93"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:35:12.372801 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-9e1e4789-d1db-49ec-b7bf-fdb6d2769ae3 req-ce4a3ef1-ad23-47ad-a6a8-cfe584684981 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:12.373291 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-9e1e4789-d1db-49ec-b7bf-fdb6d2769ae3 req-ce4a3ef1-ad23-47ad-a6a8-cfe584684981 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:12.373726 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-9e1e4789-d1db-49ec-b7bf-fdb6d2769ae3 req-ce4a3ef1-ad23-47ad-a6a8-cfe584684981 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:12.385274 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3c0421b2-89ac-443b-a728-4de958d5c3a8 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:12.385822 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3c0421b2-89ac-443b-a728-4de958d5c3a8 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:12.390499 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-9e1e4789-d1db-49ec-b7bf-fdb6d2769ae3 req-ce4a3ef1-ad23-47ad-a6a8-cfe584684981 service nova] Creating event network-vif-plugged:9b205abf-2fab-4e5a-9b1e-0110c74b9f93 for instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 on hv-cinder-80473 Nov 02 07:35:12.392179 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3c0421b2-89ac-443b-a728-4de958d5c3a8 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:12.392686 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3c0421b2-89ac-443b-a728-4de958d5c3a8 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:12.393124 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3c0421b2-89ac-443b-a728-4de958d5c3a8 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:12.393852 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3c0421b2-89ac-443b-a728-4de958d5c3a8 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:12.394618 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3c0421b2-89ac-443b-a728-4de958d5c3a8 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:12.394747 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3c0421b2-89ac-443b-a728-4de958d5c3a8 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:12.397226 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-9e1e4789-d1db-49ec-b7bf-fdb6d2769ae3 req-ce4a3ef1-ad23-47ad-a6a8-cfe584684981 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039371 Nov 02 07:35:12.398708 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 372/734] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:35:12.487930 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3c0421b2-89ac-443b-a728-4de958d5c3a8 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107490 Nov 02 07:35:12.488683 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 363/735] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 07:35:12 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:35:12.688047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a5318547-5178-487d-b144-6ab0c586f6ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:12.688660 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a5318547-5178-487d-b144-6ab0c586f6ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:12.695432 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a5318547-5178-487d-b144-6ab0c586f6ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:12.695921 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a5318547-5178-487d-b144-6ab0c586f6ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:12.696361 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a5318547-5178-487d-b144-6ab0c586f6ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:12.697054 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a5318547-5178-487d-b144-6ab0c586f6ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:12.697508 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a5318547-5178-487d-b144-6ab0c586f6ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:12.697938 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a5318547-5178-487d-b144-6ab0c586f6ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:12.805412 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ed6f3fad-943f-4446-b8e3-af3f018df13c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:12.806222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ed6f3fad-943f-4446-b8e3-af3f018df13c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:12.812755 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed6f3fad-943f-4446-b8e3-af3f018df13c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:12.813253 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed6f3fad-943f-4446-b8e3-af3f018df13c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:12.813687 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed6f3fad-943f-4446-b8e3-af3f018df13c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:12.814489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed6f3fad-943f-4446-b8e3-af3f018df13c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:12.814976 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed6f3fad-943f-4446-b8e3-af3f018df13c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:12.815420 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed6f3fad-943f-4446-b8e3-af3f018df13c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:13.002573 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a5318547-5178-487d-b144-6ab0c586f6ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:13.014075 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a5318547-5178-487d-b144-6ab0c586f6ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:13.016170 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a5318547-5178-487d-b144-6ab0c586f6ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:13.017654 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a5318547-5178-487d-b144-6ab0c586f6ad tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.334466 Nov 02 07:35:13.018296 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 373/736] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:35:12 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:35:13.113316 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ed6f3fad-943f-4446-b8e3-af3f018df13c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:13.122198 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ed6f3fad-943f-4446-b8e3-af3f018df13c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1569 microversion: 2.1 time: 0.320705 Nov 02 07:35:13.122817 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 364/737] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:12 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1569 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:35:13.146160 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-da864e3d-40e2-47cd-b562-1c5d9e235a9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:35:13.146776 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-da864e3d-40e2-47cd-b562-1c5d9e235a9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:13.153522 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da864e3d-40e2-47cd-b562-1c5d9e235a9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:13.154009 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da864e3d-40e2-47cd-b562-1c5d9e235a9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:13.154468 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da864e3d-40e2-47cd-b562-1c5d9e235a9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:13.155169 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da864e3d-40e2-47cd-b562-1c5d9e235a9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:13.155620 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da864e3d-40e2-47cd-b562-1c5d9e235a9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:13.156042 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-da864e3d-40e2-47cd-b562-1c5d9e235a9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:13.185672 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-da864e3d-40e2-47cd-b562-1c5d9e235a9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118991) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 07:35:13.256616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-da864e3d-40e2-47cd-b562-1c5d9e235a9c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "POST /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce/action" status: 202 len: 0 microversion: 2.1 time: 0.114212 Nov 02 07:35:13.258729 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 374/738] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 07:35:13 2022] POST /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:35:13.266750 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-fac4b6dc-2b61-4aaf-9292-be8923ad6fe8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:13.267369 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-fac4b6dc-2b61-4aaf-9292-be8923ad6fe8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:13.277399 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fac4b6dc-2b61-4aaf-9292-be8923ad6fe8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:13.277902 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fac4b6dc-2b61-4aaf-9292-be8923ad6fe8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:13.278341 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fac4b6dc-2b61-4aaf-9292-be8923ad6fe8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:13.279086 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fac4b6dc-2b61-4aaf-9292-be8923ad6fe8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:13.279540 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fac4b6dc-2b61-4aaf-9292-be8923ad6fe8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:13.280159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fac4b6dc-2b61-4aaf-9292-be8923ad6fe8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:13.510074 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fac4b6dc-2b61-4aaf-9292-be8923ad6fe8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:13.517996 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-fac4b6dc-2b61-4aaf-9292-be8923ad6fe8 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1517 microversion: 2.1 time: 0.255182 Nov 02 07:35:13.523483 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 365/739] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:13 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1517 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:13.856064 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-b051fb69-812b-4c54-b00a-89e3e2cad532 req-1d00dc0c-b54f-4117-911c-6b9f1b505251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d", "tag": "ad23ba36-b704-412e-8ee2-7d9ab9ce9ee2"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:35:13.869942 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-b051fb69-812b-4c54-b00a-89e3e2cad532 req-1d00dc0c-b54f-4117-911c-6b9f1b505251 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:13.870444 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-b051fb69-812b-4c54-b00a-89e3e2cad532 req-1d00dc0c-b54f-4117-911c-6b9f1b505251 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:13.870877 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-b051fb69-812b-4c54-b00a-89e3e2cad532 req-1d00dc0c-b54f-4117-911c-6b9f1b505251 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:13.881656 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-b051fb69-812b-4c54-b00a-89e3e2cad532 req-1d00dc0c-b54f-4117-911c-6b9f1b505251 service nova] Creating event network-changed:ad23ba36-b704-412e-8ee2-7d9ab9ce9ee2 for instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d on hv-cinder-80473 Nov 02 07:35:13.887067 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-b051fb69-812b-4c54-b00a-89e3e2cad532 req-1d00dc0c-b54f-4117-911c-6b9f1b505251 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107314 Nov 02 07:35:13.888214 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 375/740] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:35:14.048045 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-1dfc6b5a-8323-4178-958c-124e720c51d4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:14.048727 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-1dfc6b5a-8323-4178-958c-124e720c51d4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:14.058086 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1dfc6b5a-8323-4178-958c-124e720c51d4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:14.059274 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1dfc6b5a-8323-4178-958c-124e720c51d4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:14.059713 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1dfc6b5a-8323-4178-958c-124e720c51d4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:14.060574 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1dfc6b5a-8323-4178-958c-124e720c51d4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:14.061035 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1dfc6b5a-8323-4178-958c-124e720c51d4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:14.061462 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-1dfc6b5a-8323-4178-958c-124e720c51d4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:14.203863 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1dfc6b5a-8323-4178-958c-124e720c51d4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:14.214339 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1dfc6b5a-8323-4178-958c-124e720c51d4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:14.215917 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-1dfc6b5a-8323-4178-958c-124e720c51d4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:14.217258 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-1dfc6b5a-8323-4178-958c-124e720c51d4 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.175744 Nov 02 07:35:14.217868 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 366/741] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:35:14 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:35:14.544943 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-7083f8f1-9c14-43b3-9fa1-4ca33ff65627 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:14.545642 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-7083f8f1-9c14-43b3-9fa1-4ca33ff65627 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:14.551823 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7083f8f1-9c14-43b3-9fa1-4ca33ff65627 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:14.552308 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7083f8f1-9c14-43b3-9fa1-4ca33ff65627 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:14.552745 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7083f8f1-9c14-43b3-9fa1-4ca33ff65627 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:14.553445 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7083f8f1-9c14-43b3-9fa1-4ca33ff65627 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:14.553898 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7083f8f1-9c14-43b3-9fa1-4ca33ff65627 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:14.554463 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7083f8f1-9c14-43b3-9fa1-4ca33ff65627 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:14.610474 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-987878f7-f2aa-41f5-9111-8b655a505d50 req-c350d3e5-1a6b-4cec-85fa-9db2089789f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ad3728-5dee-49b1-a62d-3bdfca6b47ce", "name": "network-vif-unplugged", "status": "completed", "tag": "697a5305-479b-4888-ac9b-d59e4662ea13"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:35:14.621320 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-987878f7-f2aa-41f5-9111-8b655a505d50 req-c350d3e5-1a6b-4cec-85fa-9db2089789f5 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:14.621622 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-987878f7-f2aa-41f5-9111-8b655a505d50 req-c350d3e5-1a6b-4cec-85fa-9db2089789f5 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:14.622496 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-987878f7-f2aa-41f5-9111-8b655a505d50 req-c350d3e5-1a6b-4cec-85fa-9db2089789f5 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:14.658679 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.compute.server_external_events [req-987878f7-f2aa-41f5-9111-8b655a505d50 req-c350d3e5-1a6b-4cec-85fa-9db2089789f5 service nova] Unable to find a host for instance 22ad3728-5dee-49b1-a62d-3bdfca6b47ce. Dropping event network-vif-unplugged {{(pid=118992) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 07:35:14.662592 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-987878f7-f2aa-41f5-9111-8b655a505d50 req-c350d3e5-1a6b-4cec-85fa-9db2089789f5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055844 Nov 02 07:35:14.665686 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 367/742] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 02 07:35:15.058277 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7083f8f1-9c14-43b3-9fa1-4ca33ff65627 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:15.066240 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-7083f8f1-9c14-43b3-9fa1-4ca33ff65627 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1519 microversion: 2.1 time: 0.525604 Nov 02 07:35:15.067039 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 376/743] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:14 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1519 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:15.244996 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-24741468-732a-47d1-88c2-50723696978c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:15.245918 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-24741468-732a-47d1-88c2-50723696978c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:15.252954 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-24741468-732a-47d1-88c2-50723696978c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:15.255130 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-24741468-732a-47d1-88c2-50723696978c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:15.255613 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-24741468-732a-47d1-88c2-50723696978c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:15.256327 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-24741468-732a-47d1-88c2-50723696978c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:15.256818 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-24741468-732a-47d1-88c2-50723696978c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:15.257524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-24741468-732a-47d1-88c2-50723696978c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:15.280271 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=100 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:15.411855 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-24741468-732a-47d1-88c2-50723696978c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:15.424455 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-24741468-732a-47d1-88c2-50723696978c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:15.426005 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-24741468-732a-47d1-88c2-50723696978c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:15.427226 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-24741468-732a-47d1-88c2-50723696978c tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1728 microversion: 2.20 time: 0.186779 Nov 02 07:35:15.431202 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 368/744] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:35:15 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:35:16.092750 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-081e5934-1ecf-471c-99b1-d06e99cdb3b2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:16.093365 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-081e5934-1ecf-471c-99b1-d06e99cdb3b2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:16.099747 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-081e5934-1ecf-471c-99b1-d06e99cdb3b2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:16.100222 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-081e5934-1ecf-471c-99b1-d06e99cdb3b2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:16.100649 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-081e5934-1ecf-471c-99b1-d06e99cdb3b2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:16.101392 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-081e5934-1ecf-471c-99b1-d06e99cdb3b2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:16.101838 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-081e5934-1ecf-471c-99b1-d06e99cdb3b2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:16.102252 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-081e5934-1ecf-471c-99b1-d06e99cdb3b2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:16.239161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-081e5934-1ecf-471c-99b1-d06e99cdb3b2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:16.250174 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-081e5934-1ecf-471c-99b1-d06e99cdb3b2 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1575 microversion: 2.1 time: 0.161251 Nov 02 07:35:16.251163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 377/745] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:16 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:16.462317 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2d6e521c-c70c-4918-a05f-50c09bbdfde5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:16.463009 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-2d6e521c-c70c-4918-a05f-50c09bbdfde5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:16.470685 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2d6e521c-c70c-4918-a05f-50c09bbdfde5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:16.471176 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2d6e521c-c70c-4918-a05f-50c09bbdfde5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:16.471632 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2d6e521c-c70c-4918-a05f-50c09bbdfde5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:16.472335 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2d6e521c-c70c-4918-a05f-50c09bbdfde5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:16.472788 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2d6e521c-c70c-4918-a05f-50c09bbdfde5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:16.473204 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2d6e521c-c70c-4918-a05f-50c09bbdfde5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:16.607233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2d6e521c-c70c-4918-a05f-50c09bbdfde5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:16.615357 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2d6e521c-c70c-4918-a05f-50c09bbdfde5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:16.617687 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2d6e521c-c70c-4918-a05f-50c09bbdfde5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:16.619054 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-2d6e521c-c70c-4918-a05f-50c09bbdfde5 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1715 microversion: 2.20 time: 0.160900 Nov 02 07:35:16.619623 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 369/746] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:35:16 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:35:17.274617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-26ce539c-30f5-436a-a242-86a1a45cba01 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:17.275321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-26ce539c-30f5-436a-a242-86a1a45cba01 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:17.282637 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-26ce539c-30f5-436a-a242-86a1a45cba01 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:17.283119 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-26ce539c-30f5-436a-a242-86a1a45cba01 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:17.283550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-26ce539c-30f5-436a-a242-86a1a45cba01 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:17.284233 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-26ce539c-30f5-436a-a242-86a1a45cba01 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:17.284680 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-26ce539c-30f5-436a-a242-86a1a45cba01 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:17.285098 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-26ce539c-30f5-436a-a242-86a1a45cba01 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:17.421668 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-26ce539c-30f5-436a-a242-86a1a45cba01 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:17.429938 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-26ce539c-30f5-436a-a242-86a1a45cba01 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1575 microversion: 2.1 time: 0.158789 Nov 02 07:35:17.430533 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 378/747] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:17 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:18.453017 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a30557d5-3988-4904-8cec-6345f989f51f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:18.453679 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a30557d5-3988-4904-8cec-6345f989f51f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:18.461466 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a30557d5-3988-4904-8cec-6345f989f51f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:18.461950 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a30557d5-3988-4904-8cec-6345f989f51f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:18.462403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a30557d5-3988-4904-8cec-6345f989f51f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:18.463103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a30557d5-3988-4904-8cec-6345f989f51f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:18.463563 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a30557d5-3988-4904-8cec-6345f989f51f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:18.463986 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a30557d5-3988-4904-8cec-6345f989f51f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:18.599193 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a30557d5-3988-4904-8cec-6345f989f51f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:18.607534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a30557d5-3988-4904-8cec-6345f989f51f tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1575 microversion: 2.1 time: 0.158449 Nov 02 07:35:18.608104 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 370/748] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:18 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:19.631790 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2c0fe2ca-f646-48fb-a125-a956a10c93ff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:19.632940 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2c0fe2ca-f646-48fb-a125-a956a10c93ff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:19.639427 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2c0fe2ca-f646-48fb-a125-a956a10c93ff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:19.639935 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2c0fe2ca-f646-48fb-a125-a956a10c93ff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:19.640364 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2c0fe2ca-f646-48fb-a125-a956a10c93ff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:19.641042 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2c0fe2ca-f646-48fb-a125-a956a10c93ff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:19.641485 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2c0fe2ca-f646-48fb-a125-a956a10c93ff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:19.641903 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2c0fe2ca-f646-48fb-a125-a956a10c93ff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:19.769995 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2c0fe2ca-f646-48fb-a125-a956a10c93ff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:19.777818 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2c0fe2ca-f646-48fb-a125-a956a10c93ff tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1575 microversion: 2.1 time: 0.150088 Nov 02 07:35:19.778429 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 379/749] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:19 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:20.800282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-97f30ba7-c839-4def-8762-81e29c3e5cb5 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:20.800886 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-97f30ba7-c839-4def-8762-81e29c3e5cb5 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:20.807850 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-97f30ba7-c839-4def-8762-81e29c3e5cb5 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:20.808332 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-97f30ba7-c839-4def-8762-81e29c3e5cb5 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:20.808746 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-97f30ba7-c839-4def-8762-81e29c3e5cb5 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:20.809420 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-97f30ba7-c839-4def-8762-81e29c3e5cb5 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:20.809866 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-97f30ba7-c839-4def-8762-81e29c3e5cb5 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:20.810539 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-97f30ba7-c839-4def-8762-81e29c3e5cb5 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:20.942714 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-97f30ba7-c839-4def-8762-81e29c3e5cb5 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:20.950602 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-97f30ba7-c839-4def-8762-81e29c3e5cb5 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1575 microversion: 2.1 time: 0.154167 Nov 02 07:35:20.951178 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 371/750] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:20 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:21.973043 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d5849910-1716-4924-b2eb-84ed662eb5f4 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:21.973558 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-d5849910-1716-4924-b2eb-84ed662eb5f4 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:21.980424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d5849910-1716-4924-b2eb-84ed662eb5f4 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:21.980897 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d5849910-1716-4924-b2eb-84ed662eb5f4 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:21.981324 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d5849910-1716-4924-b2eb-84ed662eb5f4 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:21.981996 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d5849910-1716-4924-b2eb-84ed662eb5f4 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:21.982462 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d5849910-1716-4924-b2eb-84ed662eb5f4 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:21.982879 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d5849910-1716-4924-b2eb-84ed662eb5f4 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:22.111737 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d5849910-1716-4924-b2eb-84ed662eb5f4 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:22.120444 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d5849910-1716-4924-b2eb-84ed662eb5f4 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1575 microversion: 2.1 time: 0.151261 Nov 02 07:35:22.121003 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 380/751] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:21 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:23.144557 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-b188b719-e4df-4b59-ac66-0efa22100237 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:23.145084 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-b188b719-e4df-4b59-ac66-0efa22100237 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:23.151604 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b188b719-e4df-4b59-ac66-0efa22100237 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:23.152087 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b188b719-e4df-4b59-ac66-0efa22100237 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:23.152513 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b188b719-e4df-4b59-ac66-0efa22100237 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:23.153198 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b188b719-e4df-4b59-ac66-0efa22100237 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:23.153647 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b188b719-e4df-4b59-ac66-0efa22100237 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:23.154068 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b188b719-e4df-4b59-ac66-0efa22100237 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:23.289389 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-b188b719-e4df-4b59-ac66-0efa22100237 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:23.297012 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-b188b719-e4df-4b59-ac66-0efa22100237 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1575 microversion: 2.1 time: 0.156393 Nov 02 07:35:23.297576 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 372/752] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:23 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:24.320710 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8addd3b5-91eb-45e7-adc7-9d3faa9eb211 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:24.321326 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8addd3b5-91eb-45e7-adc7-9d3faa9eb211 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:24.327813 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8addd3b5-91eb-45e7-adc7-9d3faa9eb211 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:24.328289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8addd3b5-91eb-45e7-adc7-9d3faa9eb211 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:24.328716 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8addd3b5-91eb-45e7-adc7-9d3faa9eb211 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:24.329399 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8addd3b5-91eb-45e7-adc7-9d3faa9eb211 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:24.329846 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8addd3b5-91eb-45e7-adc7-9d3faa9eb211 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:24.330269 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8addd3b5-91eb-45e7-adc7-9d3faa9eb211 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:24.460162 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8addd3b5-91eb-45e7-adc7-9d3faa9eb211 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:24.468605 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8addd3b5-91eb-45e7-adc7-9d3faa9eb211 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1575 microversion: 2.1 time: 0.151898 Nov 02 07:35:24.469184 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 381/753] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:24 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:25.492953 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-43e588be-854a-4744-98c7-2747d6b97c5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:25.493560 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-43e588be-854a-4744-98c7-2747d6b97c5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:25.495926 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=66 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:25.501036 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-43e588be-854a-4744-98c7-2747d6b97c5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:25.501513 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-43e588be-854a-4744-98c7-2747d6b97c5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:25.501946 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-43e588be-854a-4744-98c7-2747d6b97c5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:25.502666 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-43e588be-854a-4744-98c7-2747d6b97c5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:25.503120 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-43e588be-854a-4744-98c7-2747d6b97c5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:25.503539 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-43e588be-854a-4744-98c7-2747d6b97c5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:25.634537 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-43e588be-854a-4744-98c7-2747d6b97c5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:25.642597 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-43e588be-854a-4744-98c7-2747d6b97c5c tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1575 microversion: 2.1 time: 0.153481 Nov 02 07:35:25.643165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 373/754] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:25 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:26.666565 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-16c8c89a-0806-4441-ac28-45fb6693312e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:26.667180 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-16c8c89a-0806-4441-ac28-45fb6693312e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:26.673622 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-16c8c89a-0806-4441-ac28-45fb6693312e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:26.674128 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-16c8c89a-0806-4441-ac28-45fb6693312e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:26.674602 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-16c8c89a-0806-4441-ac28-45fb6693312e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:26.675279 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-16c8c89a-0806-4441-ac28-45fb6693312e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:26.675728 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-16c8c89a-0806-4441-ac28-45fb6693312e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:26.676147 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-16c8c89a-0806-4441-ac28-45fb6693312e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:26.809141 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-16c8c89a-0806-4441-ac28-45fb6693312e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:26.816876 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-16c8c89a-0806-4441-ac28-45fb6693312e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1575 microversion: 2.1 time: 0.154178 Nov 02 07:35:26.817433 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 382/755] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:26 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:27.840581 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-5cbbf8da-51df-44b0-8a41-6ceb73e42c7b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:27.841190 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-5cbbf8da-51df-44b0-8a41-6ceb73e42c7b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:27.847747 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5cbbf8da-51df-44b0-8a41-6ceb73e42c7b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:27.848411 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5cbbf8da-51df-44b0-8a41-6ceb73e42c7b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:27.848839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5cbbf8da-51df-44b0-8a41-6ceb73e42c7b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:27.849519 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5cbbf8da-51df-44b0-8a41-6ceb73e42c7b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:27.849961 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5cbbf8da-51df-44b0-8a41-6ceb73e42c7b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:27.850392 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5cbbf8da-51df-44b0-8a41-6ceb73e42c7b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:27.983554 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-5cbbf8da-51df-44b0-8a41-6ceb73e42c7b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:27.991383 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-5cbbf8da-51df-44b0-8a41-6ceb73e42c7b tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1575 microversion: 2.1 time: 0.154723 Nov 02 07:35:27.991958 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 374/756] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:27 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:28.447523 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-c6c8f042-792b-4551-9ac7-a4ef2f7852b3 req-593eb571-48cb-4baf-9842-7fb598b244bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ad3728-5dee-49b1-a62d-3bdfca6b47ce", "name": "network-vif-plugged", "status": "completed", "tag": "697a5305-479b-4888-ac9b-d59e4662ea13"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:35:28.465901 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-c6c8f042-792b-4551-9ac7-a4ef2f7852b3 req-593eb571-48cb-4baf-9842-7fb598b244bb service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:28.466671 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-c6c8f042-792b-4551-9ac7-a4ef2f7852b3 req-593eb571-48cb-4baf-9842-7fb598b244bb service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:28.467165 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-c6c8f042-792b-4551-9ac7-a4ef2f7852b3 req-593eb571-48cb-4baf-9842-7fb598b244bb service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:28.479218 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-c6c8f042-792b-4551-9ac7-a4ef2f7852b3 req-593eb571-48cb-4baf-9842-7fb598b244bb service nova] Creating event network-vif-plugged:697a5305-479b-4888-ac9b-d59e4662ea13 for instance 22ad3728-5dee-49b1-a62d-3bdfca6b47ce on hv-cinder-80473 Nov 02 07:35:28.484968 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-c6c8f042-792b-4551-9ac7-a4ef2f7852b3 req-593eb571-48cb-4baf-9842-7fb598b244bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042189 Nov 02 07:35:28.485571 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 383/757] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:35:29.015675 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-eba01060-257d-4276-b9c2-653bf351dfac tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:29.016285 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-eba01060-257d-4276-b9c2-653bf351dfac tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:29.022625 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eba01060-257d-4276-b9c2-653bf351dfac tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:29.023624 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eba01060-257d-4276-b9c2-653bf351dfac tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:29.024048 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eba01060-257d-4276-b9c2-653bf351dfac tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:29.024731 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eba01060-257d-4276-b9c2-653bf351dfac tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:29.025175 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eba01060-257d-4276-b9c2-653bf351dfac tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:29.025616 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-eba01060-257d-4276-b9c2-653bf351dfac tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:29.160496 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-eba01060-257d-4276-b9c2-653bf351dfac tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:29.179878 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-eba01060-257d-4276-b9c2-653bf351dfac tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1575 microversion: 2.1 time: 0.167375 Nov 02 07:35:29.180823 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 375/758] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:29 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:30.203880 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5c130698-4a74-4fe8-a131-bb9673ca8355 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:30.204601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-5c130698-4a74-4fe8-a131-bb9673ca8355 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:30.211482 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5c130698-4a74-4fe8-a131-bb9673ca8355 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:30.211781 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5c130698-4a74-4fe8-a131-bb9673ca8355 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:30.212212 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5c130698-4a74-4fe8-a131-bb9673ca8355 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:30.212898 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5c130698-4a74-4fe8-a131-bb9673ca8355 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:30.213347 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5c130698-4a74-4fe8-a131-bb9673ca8355 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:30.213769 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5c130698-4a74-4fe8-a131-bb9673ca8355 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:30.344950 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-5c130698-4a74-4fe8-a131-bb9673ca8355 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:30.353276 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-5c130698-4a74-4fe8-a131-bb9673ca8355 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1575 microversion: 2.1 time: 0.154098 Nov 02 07:35:30.353836 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 384/759] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:30 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:31.376839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ed1bf0d9-b4f3-4f26-ba7e-330556771953 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:31.377450 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ed1bf0d9-b4f3-4f26-ba7e-330556771953 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:31.384929 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed1bf0d9-b4f3-4f26-ba7e-330556771953 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:31.385408 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed1bf0d9-b4f3-4f26-ba7e-330556771953 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:31.385842 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed1bf0d9-b4f3-4f26-ba7e-330556771953 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:31.386563 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed1bf0d9-b4f3-4f26-ba7e-330556771953 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:31.387016 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed1bf0d9-b4f3-4f26-ba7e-330556771953 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:31.387437 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed1bf0d9-b4f3-4f26-ba7e-330556771953 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:31.521716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ed1bf0d9-b4f3-4f26-ba7e-330556771953 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:31.530031 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ed1bf0d9-b4f3-4f26-ba7e-330556771953 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1575 microversion: 2.1 time: 0.157054 Nov 02 07:35:31.530622 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 376/760] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:31 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:32.552679 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d3b7a1c5-0a2c-46c9-be3e-87691770c14e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:32.553289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-d3b7a1c5-0a2c-46c9-be3e-87691770c14e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:32.560480 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d3b7a1c5-0a2c-46c9-be3e-87691770c14e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:32.560952 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d3b7a1c5-0a2c-46c9-be3e-87691770c14e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:32.561380 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d3b7a1c5-0a2c-46c9-be3e-87691770c14e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:32.562051 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d3b7a1c5-0a2c-46c9-be3e-87691770c14e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:32.562526 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d3b7a1c5-0a2c-46c9-be3e-87691770c14e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:32.562943 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d3b7a1c5-0a2c-46c9-be3e-87691770c14e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:32.703137 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d3b7a1c5-0a2c-46c9-be3e-87691770c14e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:32.713363 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d3b7a1c5-0a2c-46c9-be3e-87691770c14e tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1575 microversion: 2.1 time: 0.164441 Nov 02 07:35:32.715103 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 385/761] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:32 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:35:33.737860 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6bf68bc4-8e57-4357-a0e6-6db486467b92 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:35:33.738579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-6bf68bc4-8e57-4357-a0e6-6db486467b92 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:35:33.744899 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6bf68bc4-8e57-4357-a0e6-6db486467b92 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:33.745381 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6bf68bc4-8e57-4357-a0e6-6db486467b92 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:33.745813 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6bf68bc4-8e57-4357-a0e6-6db486467b92 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:33.746529 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6bf68bc4-8e57-4357-a0e6-6db486467b92 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:35:33.746983 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6bf68bc4-8e57-4357-a0e6-6db486467b92 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:35:33.747404 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6bf68bc4-8e57-4357-a0e6-6db486467b92 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:35:33.885575 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-6bf68bc4-8e57-4357-a0e6-6db486467b92 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:35:33.893448 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-6bf68bc4-8e57-4357-a0e6-6db486467b92 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1562 microversion: 2.1 time: 0.159404 Nov 02 07:35:33.894010 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 377/762] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:35:33 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:05.501708 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2038873933", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-823697442", "security_groups": [{"name": "tempest-secgroup-smoke-1042148425"}], "block_device_mapping_v2": [{"uuid": "cb8ba4a9-db98-4a69-9052-ec028c86171c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6809857-e0de-42f0-baa8-be80912a85f1"}]}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:05.514483 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6a165fc0-5649-4bec-8a23-9bdf81a43793 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:05.516926 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-6a165fc0-5649-4bec-8a23-9bdf81a43793 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:05.526261 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=9 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:05.530874 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=56 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:05.547128 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6a165fc0-5649-4bec-8a23-9bdf81a43793 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:05.551067 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6a165fc0-5649-4bec-8a23-9bdf81a43793 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:05.551774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6a165fc0-5649-4bec-8a23-9bdf81a43793 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:05.552510 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6a165fc0-5649-4bec-8a23-9bdf81a43793 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:05.552961 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6a165fc0-5649-4bec-8a23-9bdf81a43793 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:05.553384 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6a165fc0-5649-4bec-8a23-9bdf81a43793 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:05.566769 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:05.570265 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:05.606841 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-6a165fc0-5649-4bec-8a23-9bdf81a43793 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.098720 Nov 02 07:36:05.607956 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 378/763] 10.222.0.18 () {60 vars in 1343 bytes} [Wed Nov 2 07:36:05 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:36:05.699959 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2b407c76-4017-4f67-abb1-2210dd85fc4e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:05.700621 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-2b407c76-4017-4f67-abb1-2210dd85fc4e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:05.707580 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b407c76-4017-4f67-abb1-2210dd85fc4e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:05.708210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b407c76-4017-4f67-abb1-2210dd85fc4e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:05.708745 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b407c76-4017-4f67-abb1-2210dd85fc4e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:05.710008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b407c76-4017-4f67-abb1-2210dd85fc4e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:05.710602 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b407c76-4017-4f67-abb1-2210dd85fc4e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:05.711122 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2b407c76-4017-4f67-abb1-2210dd85fc4e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:05.756400 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-2b407c76-4017-4f67-abb1-2210dd85fc4e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Going to try to terminate instance {{(pid=118992) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:36:05.784196 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.network.neutron [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] validate_networks() for [('f6809857-e0de-42f0-baa8-be80912a85f1', None, None, None, None, None)] {{(pid=118991) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:36:05.892381 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-2b407c76-4017-4f67-abb1-2210dd85fc4e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 204 len: 0 microversion: 2.20 time: 0.194820 Nov 02 07:36:05.894048 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 379/764] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 07:36:05 2022] DELETE /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 07:36:05.904495 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-fd955ff0-81cc-4a9d-9330-7852924f662f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:05.905326 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-fd955ff0-81cc-4a9d-9330-7852924f662f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:05.911891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd955ff0-81cc-4a9d-9330-7852924f662f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:05.913546 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd955ff0-81cc-4a9d-9330-7852924f662f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:05.914068 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd955ff0-81cc-4a9d-9330-7852924f662f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:05.914875 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd955ff0-81cc-4a9d-9330-7852924f662f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:05.915409 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd955ff0-81cc-4a9d-9330-7852924f662f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:05.916533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fd955ff0-81cc-4a9d-9330-7852924f662f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:06.237384 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fd955ff0-81cc-4a9d-9330-7852924f662f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:06.254880 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fd955ff0-81cc-4a9d-9330-7852924f662f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:06.256944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fd955ff0-81cc-4a9d-9330-7852924f662f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:06.259025 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-fd955ff0-81cc-4a9d-9330-7852924f662f tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.359836 Nov 02 07:36:06.260793 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 380/765] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:36:05 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:36:06.843281 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Flavor limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:36:06.844862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Image limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:36:06.845483 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Flavor pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:36:06.846035 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Image pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:36:06.846615 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:36:06.860798 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:06.861452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:06.862036 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:06.862994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:06.863590 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:06.864289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:06.891614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Getting quotas for project 566514b413e24aaebe69c11ce2159ac9. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:36:06.897305 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Getting quotas for user fe26aea6bb9d4dcebf046da719b2c244 and project 566514b413e24aaebe69c11ce2159ac9. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:36:07.021315 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Going to run 1 instances... {{(pid=118991) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:36:07.024563 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb8ba4a9-db98-4a69-9052-ec028c86171c',volume_size=None,volume_type=None)] {{(pid=118991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:36:07.209815 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-acc4f986-2344-43fd-905b-528cd2b8919d tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.714871 Nov 02 07:36:07.211426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 386/766] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:36:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 07:36:07.223095 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f037096a-cc67-4d95-bff0-fbdacb45d980 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:07.224324 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f037096a-cc67-4d95-bff0-fbdacb45d980 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:07.293188 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a6e923bc-f4ff-45e3-b518-ed1e286ed222 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:07.294267 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a6e923bc-f4ff-45e3-b518-ed1e286ed222 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:07.301140 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6e923bc-f4ff-45e3-b518-ed1e286ed222 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:07.302013 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6e923bc-f4ff-45e3-b518-ed1e286ed222 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:07.303089 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6e923bc-f4ff-45e3-b518-ed1e286ed222 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:07.304040 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6e923bc-f4ff-45e3-b518-ed1e286ed222 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:07.304721 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6e923bc-f4ff-45e3-b518-ed1e286ed222 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:07.305371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a6e923bc-f4ff-45e3-b518-ed1e286ed222 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:07.630073 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f037096a-cc67-4d95-bff0-fbdacb45d980 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:07.639625 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f037096a-cc67-4d95-bff0-fbdacb45d980 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1094 microversion: 2.1 time: 0.420469 Nov 02 07:36:07.643523 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 381/767] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:07 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1094 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:07.805653 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a6e923bc-f4ff-45e3-b518-ed1e286ed222 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:07.823080 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a6e923bc-f4ff-45e3-b518-ed1e286ed222 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:07.824507 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a6e923bc-f4ff-45e3-b518-ed1e286ed222 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:07.825682 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a6e923bc-f4ff-45e3-b518-ed1e286ed222 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1721 microversion: 2.20 time: 0.537208 Nov 02 07:36:07.827785 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 387/768] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:36:07 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1721 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 07:36:08.669734 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9b6d86dd-af6f-43cc-866b-9ce8d1a910e4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:08.673549 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9b6d86dd-af6f-43cc-866b-9ce8d1a910e4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:08.690795 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9b6d86dd-af6f-43cc-866b-9ce8d1a910e4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:08.692708 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9b6d86dd-af6f-43cc-866b-9ce8d1a910e4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:08.693313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9b6d86dd-af6f-43cc-866b-9ce8d1a910e4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:08.694210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9b6d86dd-af6f-43cc-866b-9ce8d1a910e4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:08.694704 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9b6d86dd-af6f-43cc-866b-9ce8d1a910e4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:08.695131 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9b6d86dd-af6f-43cc-866b-9ce8d1a910e4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:08.830180 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9b6d86dd-af6f-43cc-866b-9ce8d1a910e4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:08.842997 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9b6d86dd-af6f-43cc-866b-9ce8d1a910e4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1192 microversion: 2.1 time: 0.179408 Nov 02 07:36:08.843592 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 382/769] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:08 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1192 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:08.863070 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-73d435f1-1c49-4dee-be2b-a9efd390777e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:08.863692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-73d435f1-1c49-4dee-be2b-a9efd390777e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:08.913602 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-73d435f1-1c49-4dee-be2b-a9efd390777e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:08.914276 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-73d435f1-1c49-4dee-be2b-a9efd390777e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:08.918674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-73d435f1-1c49-4dee-be2b-a9efd390777e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:08.921361 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-73d435f1-1c49-4dee-be2b-a9efd390777e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:08.923151 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-73d435f1-1c49-4dee-be2b-a9efd390777e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:08.936787 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-59962769-68b1-42bc-9429-959d2163ddfb req-40721e4c-9063-4983-9a87-3640460bd442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e24f861-ba20-4595-9dd5-9ea1f9832284", "name": "network-vif-deleted", "tag": "9b205abf-2fab-4e5a-9b1e-0110c74b9f93"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:08.950448 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-73d435f1-1c49-4dee-be2b-a9efd390777e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:08.967810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-59962769-68b1-42bc-9429-959d2163ddfb req-40721e4c-9063-4983-9a87-3640460bd442 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:08.968299 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-59962769-68b1-42bc-9429-959d2163ddfb req-40721e4c-9063-4983-9a87-3640460bd442 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:08.968748 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-59962769-68b1-42bc-9429-959d2163ddfb req-40721e4c-9063-4983-9a87-3640460bd442 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:09.034931 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-59962769-68b1-42bc-9429-959d2163ddfb req-40721e4c-9063-4983-9a87-3640460bd442 service nova] Creating event network-vif-deleted:9b205abf-2fab-4e5a-9b1e-0110c74b9f93 for instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 on hv-cinder-80473 Nov 02 07:36:09.053073 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-59962769-68b1-42bc-9429-959d2163ddfb req-40721e4c-9063-4983-9a87-3640460bd442 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122899 Nov 02 07:36:09.062088 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 383/770] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:36:09.202472 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-73d435f1-1c49-4dee-be2b-a9efd390777e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:09.218352 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-73d435f1-1c49-4dee-be2b-a9efd390777e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:09.220995 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-73d435f1-1c49-4dee-be2b-a9efd390777e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2455ebfc92ba4d398a6279d6102a0408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df168e1504c947169b74f50c1ed4de95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:09.222681 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-73d435f1-1c49-4dee-be2b-a9efd390777e tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 200 len: 1654 microversion: 2.20 time: 0.363777 Nov 02 07:36:09.224409 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 388/771] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:36:08 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 1654 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 07:36:09.743601 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9730e329-589e-4ff8-a637-e2d9e9aeaa21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:09.744811 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9730e329-589e-4ff8-a637-e2d9e9aeaa21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:09.753171 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9730e329-589e-4ff8-a637-e2d9e9aeaa21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:09.753905 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9730e329-589e-4ff8-a637-e2d9e9aeaa21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:09.754640 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9730e329-589e-4ff8-a637-e2d9e9aeaa21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:09.755804 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9730e329-589e-4ff8-a637-e2d9e9aeaa21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:09.756559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9730e329-589e-4ff8-a637-e2d9e9aeaa21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:09.757316 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9730e329-589e-4ff8-a637-e2d9e9aeaa21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:09.819556 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9730e329-589e-4ff8-a637-e2d9e9aeaa21 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d/ips" status: 200 len: 148 microversion: 2.1 time: 0.463756 Nov 02 07:36:09.822644 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 384/772] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 07:36:09 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d/ips => generated 148 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:36:09.873386 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-036e4d3e-9beb-4844-ac92-88468269b099 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:09.874073 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-036e4d3e-9beb-4844-ac92-88468269b099 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:09.887408 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-036e4d3e-9beb-4844-ac92-88468269b099 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:09.887916 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-036e4d3e-9beb-4844-ac92-88468269b099 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:09.888357 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-036e4d3e-9beb-4844-ac92-88468269b099 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:09.891862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-036e4d3e-9beb-4844-ac92-88468269b099 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:09.892717 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-036e4d3e-9beb-4844-ac92-88468269b099 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:09.893169 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-036e4d3e-9beb-4844-ac92-88468269b099 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:10.071427 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-036e4d3e-9beb-4844-ac92-88468269b099 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:10.082901 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-036e4d3e-9beb-4844-ac92-88468269b099 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1210 microversion: 2.1 time: 0.213542 Nov 02 07:36:10.087189 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 389/773] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:09 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1210 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:10.252421 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f292f9a7-5fb9-4012-8935-cbf7ed812e35 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:10.253114 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f292f9a7-5fb9-4012-8935-cbf7ed812e35 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:10.269343 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f292f9a7-5fb9-4012-8935-cbf7ed812e35 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:10.270935 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f292f9a7-5fb9-4012-8935-cbf7ed812e35 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:10.272939 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f292f9a7-5fb9-4012-8935-cbf7ed812e35 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:10.276155 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f292f9a7-5fb9-4012-8935-cbf7ed812e35 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:10.277085 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f292f9a7-5fb9-4012-8935-cbf7ed812e35 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:10.277678 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f292f9a7-5fb9-4012-8935-cbf7ed812e35 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:10.300180 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-f292f9a7-5fb9-4012-8935-cbf7ed812e35 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] HTTP exception thrown: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f292f9a7-5fb9-4012-8935-cbf7ed812e35 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Request method failure captured: Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 HTTP/1.1 Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhxWuTpbS47usYs0qSbI_CRGJyPC087ezEilEmqpOstTAdji_P96WqXa2OhChVtSUZjArS0_us3sPUI1q2-yh7TL-8laTUy7TdNOH6oFa4XCrYLW3j3fgyjT5p1YtRc6sQVovx1mu8rs5ZdpKMLDJhVNB_4eKtrpMY872kal00p-mso Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: df168e1504c947169b74f50c1ed4de95 Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:36:10.301872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:36:10.303709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_df168e1504c947169b74f50c1ed4de95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:36:10.303709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:36:10.303709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: df168e1504c947169b74f50c1ed4de95 Nov 02 07:36:10.303709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:36:10.303709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-AttachVolumeShelveTestJSON-163710944-project Nov 02 07:36:10.303709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:36:10.303709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:36:10.303709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 2455ebfc92ba4d398a6279d6102a0408 Nov 02 07:36:10.303709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-AttachVolumeShelveTestJSON-163710944-project Nov 02 07:36:10.303709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:36:10.303709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. Nov 02 07:36:10.303709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '1e24f861-ba20-4595-9dd5-9ea1f9832284'} Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:36:10.304838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. Nov 02 07:36:10.306133 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:10.307668 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f292f9a7-5fb9-4012-8935-cbf7ed812e35 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Returning 404 to user: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:36:10.307668 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f292f9a7-5fb9-4012-8935-cbf7ed812e35 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 404 len: 111 microversion: 2.20 time: 0.054908 Nov 02 07:36:10.307668 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 385/774] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:36:10 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 07:36:10.312832 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5aa92c0d-e7f5-422d-9929-efc0bba48d63 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '.version_select at 0x7f4d6a1bb940>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:10.350382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-5aa92c0d-e7f5-422d-9929-efc0bba48d63 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1441580938" status: 204 len: 0 microversion: 2.20 time: 0.041377 Nov 02 07:36:10.350949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 390/775] 10.222.0.18 () {60 vars in 1262 bytes} [Wed Nov 2 07:36:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1441580938 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 07:36:11.119404 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e3697efe-4c4e-4027-81b5-594aab43f44c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:11.121239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e3697efe-4c4e-4027-81b5-594aab43f44c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:11.158325 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e3697efe-4c4e-4027-81b5-594aab43f44c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:11.159962 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e3697efe-4c4e-4027-81b5-594aab43f44c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:11.160576 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e3697efe-4c4e-4027-81b5-594aab43f44c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:11.163398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e3697efe-4c4e-4027-81b5-594aab43f44c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:11.166303 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e3697efe-4c4e-4027-81b5-594aab43f44c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:11.167522 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e3697efe-4c4e-4027-81b5-594aab43f44c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:11.409967 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-e3697efe-4c4e-4027-81b5-594aab43f44c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:11.423744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e3697efe-4c4e-4027-81b5-594aab43f44c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1266 microversion: 2.1 time: 0.307970 Nov 02 07:36:11.427263 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 386/776] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:11 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:11.574552 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-fab3c6c0-4e0b-4c6b-a115-fd74e367740c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1ce31a5-efaa-4287-b7dc-40ce8188db08"}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:11.577397 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-fab3c6c0-4e0b-4c6b-a115-fd74e367740c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:11.594650 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fab3c6c0-4e0b-4c6b-a115-fd74e367740c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:11.595678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fab3c6c0-4e0b-4c6b-a115-fd74e367740c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:11.599557 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fab3c6c0-4e0b-4c6b-a115-fd74e367740c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:11.600440 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fab3c6c0-4e0b-4c6b-a115-fd74e367740c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:11.601049 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fab3c6c0-4e0b-4c6b-a115-fd74e367740c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:11.602930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fab3c6c0-4e0b-4c6b-a115-fd74e367740c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:11.905543 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-b86cd5c4-268a-4e0e-be92-2ed9ae4c6fe3 req-34e6665e-d93d-4fe5-83ec-320263d40736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f0c6bc8-dd75-40d4-8aa9-db602c43827f", "tag": "a8803367-51f8-419d-a4e7-a51526460bb6"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:11.936899 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-b86cd5c4-268a-4e0e-be92-2ed9ae4c6fe3 req-34e6665e-d93d-4fe5-83ec-320263d40736 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:11.941325 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-b86cd5c4-268a-4e0e-be92-2ed9ae4c6fe3 req-34e6665e-d93d-4fe5-83ec-320263d40736 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:11.944831 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-b86cd5c4-268a-4e0e-be92-2ed9ae4c6fe3 req-34e6665e-d93d-4fe5-83ec-320263d40736 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:11.987962 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-b86cd5c4-268a-4e0e-be92-2ed9ae4c6fe3 req-34e6665e-d93d-4fe5-83ec-320263d40736 service nova] Creating event network-changed:a8803367-51f8-419d-a4e7-a51526460bb6 for instance 8f0c6bc8-dd75-40d4-8aa9-db602c43827f on hv-cinder-80473 Nov 02 07:36:12.004099 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-b86cd5c4-268a-4e0e-be92-2ed9ae4c6fe3 req-34e6665e-d93d-4fe5-83ec-320263d40736 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096395 Nov 02 07:36:12.006844 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 387/777] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:36:12.097886 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-fab3c6c0-4e0b-4c6b-a115-fd74e367740c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "POST /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.527741 Nov 02 07:36:12.118850 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 391/778] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 07:36:11 2022] POST /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d/os-volume_attachments => generated 194 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:36:12.450445 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-284f71e9-ceac-4af8-b7bf-7ac9ac348ff7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:12.451144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-284f71e9-ceac-4af8-b7bf-7ac9ac348ff7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:12.463735 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-284f71e9-ceac-4af8-b7bf-7ac9ac348ff7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:12.464525 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-284f71e9-ceac-4af8-b7bf-7ac9ac348ff7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:12.465104 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-284f71e9-ceac-4af8-b7bf-7ac9ac348ff7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:12.465979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-284f71e9-ceac-4af8-b7bf-7ac9ac348ff7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:12.466618 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-284f71e9-ceac-4af8-b7bf-7ac9ac348ff7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:12.467314 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-284f71e9-ceac-4af8-b7bf-7ac9ac348ff7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:12.674285 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-284f71e9-ceac-4af8-b7bf-7ac9ac348ff7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:12.683763 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-284f71e9-ceac-4af8-b7bf-7ac9ac348ff7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1266 microversion: 2.1 time: 0.238243 Nov 02 07:36:12.685535 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 388/779] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:12 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:12.890312 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d1e74869-44ec-4dd9-9e3b-6503c860d46a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:12.891773 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-d1e74869-44ec-4dd9-9e3b-6503c860d46a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:12.902445 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d1e74869-44ec-4dd9-9e3b-6503c860d46a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:12.902890 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d1e74869-44ec-4dd9-9e3b-6503c860d46a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:12.903542 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d1e74869-44ec-4dd9-9e3b-6503c860d46a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:12.904778 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d1e74869-44ec-4dd9-9e3b-6503c860d46a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:12.905264 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d1e74869-44ec-4dd9-9e3b-6503c860d46a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:12.905699 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d1e74869-44ec-4dd9-9e3b-6503c860d46a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:12.937285 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-d1e74869-44ec-4dd9-9e3b-6503c860d46a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] HTTP exception thrown: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d1e74869-44ec-4dd9-9e3b-6503c860d46a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Request method failure captured: Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: DELETE /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 HTTP/1.1 Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhxWuTpbS47usYs0qSbI_CRGJyPC087ezEilEmqpOstTAdji_P96WqXa2OhChVtSUZjArS0_us3sPUI1q2-yh7TL-8laTUy7TdNOH6oFa4XCrYLW3j3fgyjT5p1YtRc6sQVovx1mu8rs5ZdpKMLDJhVNB_4eKtrpMY872kal00p-mso Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: df168e1504c947169b74f50c1ed4de95 Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:36:12.940371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:36:12.942053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_df168e1504c947169b74f50c1ed4de95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:36:12.942053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:36:12.942053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: df168e1504c947169b74f50c1ed4de95 Nov 02 07:36:12.942053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:36:12.942053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-AttachVolumeShelveTestJSON-163710944-project Nov 02 07:36:12.942053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:36:12.942053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:36:12.942053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 2455ebfc92ba4d398a6279d6102a0408 Nov 02 07:36:12.942053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-AttachVolumeShelveTestJSON-163710944-project Nov 02 07:36:12.942053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:36:12.942053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. Nov 02 07:36:12.942053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': '1e24f861-ba20-4595-9dd5-9ea1f9832284'} Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:36:12.942955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. Nov 02 07:36:12.944410 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:12.945945 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d1e74869-44ec-4dd9-9e3b-6503c860d46a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Returning 404 to user: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:36:12.945945 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d1e74869-44ec-4dd9-9e3b-6503c860d46a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 404 len: 111 microversion: 2.20 time: 0.059828 Nov 02 07:36:12.946386 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 392/780] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 07:36:12 2022] DELETE /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 07:36:12.954544 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-68e9399f-5344-467f-9b13-6a12a90280a3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:12.955139 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-68e9399f-5344-467f-9b13-6a12a90280a3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: 1e24f861-ba20-4595-9dd5-9ea1f9832284] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:12.961352 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68e9399f-5344-467f-9b13-6a12a90280a3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:12.961841 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68e9399f-5344-467f-9b13-6a12a90280a3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:12.962280 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68e9399f-5344-467f-9b13-6a12a90280a3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:12.963004 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68e9399f-5344-467f-9b13-6a12a90280a3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:12.963445 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68e9399f-5344-467f-9b13-6a12a90280a3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:12.964057 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68e9399f-5344-467f-9b13-6a12a90280a3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:12.988740 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-68e9399f-5344-467f-9b13-6a12a90280a3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] HTTP exception thrown: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-68e9399f-5344-467f-9b13-6a12a90280a3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Request method failure captured: Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 HTTP/1.1 Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhxWuTpbS47usYs0qSbI_CRGJyPC087ezEilEmqpOstTAdji_P96WqXa2OhChVtSUZjArS0_us3sPUI1q2-yh7TL-8laTUy7TdNOH6oFa4XCrYLW3j3fgyjT5p1YtRc6sQVovx1mu8rs5ZdpKMLDJhVNB_4eKtrpMY872kal00p-mso Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: df168e1504c947169b74f50c1ed4de95 Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:36:12.990674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:36:12.992360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_df168e1504c947169b74f50c1ed4de95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:36:12.992360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:36:12.992360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: df168e1504c947169b74f50c1ed4de95 Nov 02 07:36:12.992360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:36:12.992360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-AttachVolumeShelveTestJSON-163710944-project Nov 02 07:36:12.992360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:36:12.992360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:36:12.992360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 2455ebfc92ba4d398a6279d6102a0408 Nov 02 07:36:12.992360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-AttachVolumeShelveTestJSON-163710944-project Nov 02 07:36:12.992360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:36:12.992360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. Nov 02 07:36:12.992360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '1e24f861-ba20-4595-9dd5-9ea1f9832284'} Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:36:12.993230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. Nov 02 07:36:12.994653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:12.996791 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-68e9399f-5344-467f-9b13-6a12a90280a3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Returning 404 to user: Instance 1e24f861-ba20-4595-9dd5-9ea1f9832284 could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:36:12.998140 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-68e9399f-5344-467f-9b13-6a12a90280a3 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284" status: 404 len: 111 microversion: 2.20 time: 0.047508 Nov 02 07:36:12.998813 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 389/781] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:36:12 2022] GET /compute/v2.1/servers/1e24f861-ba20-4595-9dd5-9ea1f9832284 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 07:36:13.707508 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5608eb86-7cf5-41f4-a134-5e8b2c2719e7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:13.708520 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-5608eb86-7cf5-41f4-a134-5e8b2c2719e7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:13.715130 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5608eb86-7cf5-41f4-a134-5e8b2c2719e7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:13.716920 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5608eb86-7cf5-41f4-a134-5e8b2c2719e7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:13.717530 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5608eb86-7cf5-41f4-a134-5e8b2c2719e7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:13.718666 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5608eb86-7cf5-41f4-a134-5e8b2c2719e7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:13.719985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5608eb86-7cf5-41f4-a134-5e8b2c2719e7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:13.720805 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5608eb86-7cf5-41f4-a134-5e8b2c2719e7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:13.890037 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-5608eb86-7cf5-41f4-a134-5e8b2c2719e7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:13.902428 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-5608eb86-7cf5-41f4-a134-5e8b2c2719e7 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1266 microversion: 2.1 time: 0.198972 Nov 02 07:36:13.905542 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 393/782] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:13 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:14.192933 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-730d7f4c-b9a5-4a7d-aceb-12c0b7da800a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:14.193585 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-730d7f4c-b9a5-4a7d-aceb-12c0b7da800a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:14.201373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-730d7f4c-b9a5-4a7d-aceb-12c0b7da800a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:14.202116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-730d7f4c-b9a5-4a7d-aceb-12c0b7da800a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:14.202753 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-730d7f4c-b9a5-4a7d-aceb-12c0b7da800a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:14.204116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-730d7f4c-b9a5-4a7d-aceb-12c0b7da800a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:14.204831 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-730d7f4c-b9a5-4a7d-aceb-12c0b7da800a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:14.206639 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-730d7f4c-b9a5-4a7d-aceb-12c0b7da800a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:14.222785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-730d7f4c-b9a5-4a7d-aceb-12c0b7da800a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] HTTP exception thrown: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-730d7f4c-b9a5-4a7d-aceb-12c0b7da800a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Request method failure captured: Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: DELETE /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df HTTP/1.1 Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhxWuTpbS47usYs0qSbI_CRGJyPC087ezEilEmqpOstTAdji_P96WqXa2OhChVtSUZjArS0_us3sPUI1q2-yh7TL-8laTUy7TdNOH6oFa4XCrYLW3j3fgyjT5p1YtRc6sQVovx1mu8rs5ZdpKMLDJhVNB_4eKtrpMY872kal00p-mso Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: df168e1504c947169b74f50c1ed4de95 Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:36:14.224722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:36:14.226309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_df168e1504c947169b74f50c1ed4de95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:36:14.226309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:36:14.226309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: df168e1504c947169b74f50c1ed4de95 Nov 02 07:36:14.226309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:36:14.226309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-AttachVolumeShelveTestJSON-163710944-project Nov 02 07:36:14.226309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:36:14.226309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:36:14.226309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 2455ebfc92ba4d398a6279d6102a0408 Nov 02 07:36:14.226309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-AttachVolumeShelveTestJSON-163710944-project Nov 02 07:36:14.226309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:36:14.226309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. Nov 02 07:36:14.226309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': 'cae04f42-6d0d-42e5-ae5f-8022b6f546df'} Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:36:14.227257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. Nov 02 07:36:14.230759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:14.232218 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-730d7f4c-b9a5-4a7d-aceb-12c0b7da800a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Returning 404 to user: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:36:14.232218 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-730d7f4c-b9a5-4a7d-aceb-12c0b7da800a tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 404 len: 111 microversion: 2.20 time: 0.038390 Nov 02 07:36:14.232218 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 390/783] 10.222.0.18 () {60 vars in 1280 bytes} [Wed Nov 2 07:36:14 2022] DELETE /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 07:36:14.236503 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5fcfdc0d-4722-4564-a0ea-de05afd0af23 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:14.237110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-5fcfdc0d-4722-4564-a0ea-de05afd0af23 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] [instance: cae04f42-6d0d-42e5-ae5f-8022b6f546df] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:14.243950 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5fcfdc0d-4722-4564-a0ea-de05afd0af23 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:14.244430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5fcfdc0d-4722-4564-a0ea-de05afd0af23 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:14.244859 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5fcfdc0d-4722-4564-a0ea-de05afd0af23 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:14.245549 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5fcfdc0d-4722-4564-a0ea-de05afd0af23 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:14.246001 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5fcfdc0d-4722-4564-a0ea-de05afd0af23 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:14.246441 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-5fcfdc0d-4722-4564-a0ea-de05afd0af23 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:14.261772 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-5fcfdc0d-4722-4564-a0ea-de05afd0af23 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] HTTP exception thrown: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5fcfdc0d-4722-4564-a0ea-de05afd0af23 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Request method failure captured: Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df HTTP/1.1 Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhxWuTpbS47usYs0qSbI_CRGJyPC087ezEilEmqpOstTAdji_P96WqXa2OhChVtSUZjArS0_us3sPUI1q2-yh7TL-8laTUy7TdNOH6oFa4XCrYLW3j3fgyjT5p1YtRc6sQVovx1mu8rs5ZdpKMLDJhVNB_4eKtrpMY872kal00p-mso Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: df168e1504c947169b74f50c1ed4de95 Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:36:14.263341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:36:14.264977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_df168e1504c947169b74f50c1ed4de95", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/df168e1504c947169b74f50c1ed4de95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:36:14.264977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:36:14.264977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: df168e1504c947169b74f50c1ed4de95 Nov 02 07:36:14.264977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-163710944 Nov 02 07:36:14.264977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-AttachVolumeShelveTestJSON-163710944-project Nov 02 07:36:14.264977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:36:14.264977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:36:14.264977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 2455ebfc92ba4d398a6279d6102a0408 Nov 02 07:36:14.264977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-AttachVolumeShelveTestJSON-163710944-project Nov 02 07:36:14.264977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:36:14.264977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. Nov 02 07:36:14.264977 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': 'cae04f42-6d0d-42e5-ae5f-8022b6f546df'} Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:36:14.268139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. Nov 02 07:36:14.269612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:14.270949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5fcfdc0d-4722-4564-a0ea-de05afd0af23 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] Returning 404 to user: Instance cae04f42-6d0d-42e5-ae5f-8022b6f546df could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:36:14.270949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-5fcfdc0d-4722-4564-a0ea-de05afd0af23 tempest-AttachVolumeShelveTestJSON-163710944 tempest-AttachVolumeShelveTestJSON-163710944-project] 10.222.0.18 "GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df" status: 404 len: 111 microversion: 2.20 time: 0.032069 Nov 02 07:36:14.274527 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 394/784] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Nov 2 07:36:14 2022] GET /compute/v2.1/servers/cae04f42-6d0d-42e5-ae5f-8022b6f546df => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 07:36:14.929586 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-81d3ee69-b19a-4316-b918-4cc7df6dd8ba tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:14.930413 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-81d3ee69-b19a-4316-b918-4cc7df6dd8ba tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:14.936915 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81d3ee69-b19a-4316-b918-4cc7df6dd8ba tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:14.937744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81d3ee69-b19a-4316-b918-4cc7df6dd8ba tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:14.938424 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81d3ee69-b19a-4316-b918-4cc7df6dd8ba tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:14.939343 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81d3ee69-b19a-4316-b918-4cc7df6dd8ba tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:14.940016 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81d3ee69-b19a-4316-b918-4cc7df6dd8ba tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:14.940650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81d3ee69-b19a-4316-b918-4cc7df6dd8ba tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:15.196395 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-81d3ee69-b19a-4316-b918-4cc7df6dd8ba tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:15.220197 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-81d3ee69-b19a-4316-b918-4cc7df6dd8ba tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1266 microversion: 2.1 time: 0.293859 Nov 02 07:36:15.223575 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 391/785] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:14 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:16.246918 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2d54b3ba-395c-4013-86dd-3b6f2cb7175b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:16.247541 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2d54b3ba-395c-4013-86dd-3b6f2cb7175b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:16.254720 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2d54b3ba-395c-4013-86dd-3b6f2cb7175b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:16.255463 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2d54b3ba-395c-4013-86dd-3b6f2cb7175b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:16.256404 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2d54b3ba-395c-4013-86dd-3b6f2cb7175b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:16.257119 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2d54b3ba-395c-4013-86dd-3b6f2cb7175b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:16.257568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2d54b3ba-395c-4013-86dd-3b6f2cb7175b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:16.260246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2d54b3ba-395c-4013-86dd-3b6f2cb7175b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:16.623727 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2d54b3ba-395c-4013-86dd-3b6f2cb7175b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:16.632962 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2d54b3ba-395c-4013-86dd-3b6f2cb7175b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1266 microversion: 2.1 time: 0.389888 Nov 02 07:36:16.648824 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 395/786] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:16 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1266 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:17.656325 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-62078eed-c6e7-4b7c-bec2-247b821231e9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:17.657903 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-62078eed-c6e7-4b7c-bec2-247b821231e9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:17.684127 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:17.690478 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-62078eed-c6e7-4b7c-bec2-247b821231e9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:17.691212 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-62078eed-c6e7-4b7c-bec2-247b821231e9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:17.691970 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-62078eed-c6e7-4b7c-bec2-247b821231e9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:17.693378 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-62078eed-c6e7-4b7c-bec2-247b821231e9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:17.693976 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-62078eed-c6e7-4b7c-bec2-247b821231e9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:17.694484 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-62078eed-c6e7-4b7c-bec2-247b821231e9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:17.927761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-62078eed-c6e7-4b7c-bec2-247b821231e9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:17.937600 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-62078eed-c6e7-4b7c-bec2-247b821231e9 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1266 microversion: 2.1 time: 0.284833 Nov 02 07:36:17.962111 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 392/787] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:17 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:18.970756 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-dcb524a7-de0d-442f-a39f-78f47bd0fd5e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:18.972337 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-dcb524a7-de0d-442f-a39f-78f47bd0fd5e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:18.977980 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:18.979234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=6 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:18.996715 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dcb524a7-de0d-442f-a39f-78f47bd0fd5e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:18.997210 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dcb524a7-de0d-442f-a39f-78f47bd0fd5e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:18.997645 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dcb524a7-de0d-442f-a39f-78f47bd0fd5e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:18.998380 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dcb524a7-de0d-442f-a39f-78f47bd0fd5e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:18.998937 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dcb524a7-de0d-442f-a39f-78f47bd0fd5e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:18.999369 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-dcb524a7-de0d-442f-a39f-78f47bd0fd5e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:19.176276 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-dcb524a7-de0d-442f-a39f-78f47bd0fd5e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:19.184827 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-dcb524a7-de0d-442f-a39f-78f47bd0fd5e tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1266 microversion: 2.1 time: 0.222950 Nov 02 07:36:19.198385 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 396/788] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:18 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:20.131251 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f7633094-5d6e-45f1-8608-9e8f2ea480e5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:20.132464 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f7633094-5d6e-45f1-8608-9e8f2ea480e5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:20.139144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f7633094-5d6e-45f1-8608-9e8f2ea480e5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:20.139853 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f7633094-5d6e-45f1-8608-9e8f2ea480e5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:20.140460 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f7633094-5d6e-45f1-8608-9e8f2ea480e5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:20.141853 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f7633094-5d6e-45f1-8608-9e8f2ea480e5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:20.142595 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f7633094-5d6e-45f1-8608-9e8f2ea480e5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:20.143173 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f7633094-5d6e-45f1-8608-9e8f2ea480e5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:20.213810 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-93a4ced6-562b-4b73-9053-7fc0064af577 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:20.215117 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-93a4ced6-562b-4b73-9053-7fc0064af577 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:20.225443 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-93a4ced6-562b-4b73-9053-7fc0064af577 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:20.227003 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-93a4ced6-562b-4b73-9053-7fc0064af577 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:20.227838 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-93a4ced6-562b-4b73-9053-7fc0064af577 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:20.228864 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-93a4ced6-562b-4b73-9053-7fc0064af577 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:20.229563 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-93a4ced6-562b-4b73-9053-7fc0064af577 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:20.230267 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-93a4ced6-562b-4b73-9053-7fc0064af577 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:20.242120 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-f7633094-5d6e-45f1-8608-9e8f2ea480e5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lazy-loading 'services' on Instance uuid 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:36:20.346570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f7633094-5d6e-45f1-8608-9e8f2ea480e5 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d/os-volume_attachments/e1ce31a5-efaa-4287-b7dc-40ce8188db08" status: 202 len: 0 microversion: 2.1 time: 0.212485 Nov 02 07:36:20.352061 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 393/789] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 07:36:20 2022] DELETE /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d/os-volume_attachments/e1ce31a5-efaa-4287-b7dc-40ce8188db08 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:36:20.358781 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-502b9564-8a94-4f92-885b-fd6b6d4dfdd3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:20.362695 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-502b9564-8a94-4f92-885b-fd6b6d4dfdd3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:20.369707 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-502b9564-8a94-4f92-885b-fd6b6d4dfdd3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:20.370487 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-502b9564-8a94-4f92-885b-fd6b6d4dfdd3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:20.371079 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-502b9564-8a94-4f92-885b-fd6b6d4dfdd3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:20.371957 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-502b9564-8a94-4f92-885b-fd6b6d4dfdd3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:20.372730 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-502b9564-8a94-4f92-885b-fd6b6d4dfdd3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:20.373727 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-502b9564-8a94-4f92-885b-fd6b6d4dfdd3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:20.440561 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-502b9564-8a94-4f92-885b-fd6b6d4dfdd3 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086981 Nov 02 07:36:20.441361 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 394/790] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 07:36:20 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:36:20.451442 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-93a4ced6-562b-4b73-9053-7fc0064af577 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:20.468862 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-93a4ced6-562b-4b73-9053-7fc0064af577 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1266 microversion: 2.1 time: 0.262673 Nov 02 07:36:20.486952 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 397/791] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:20 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:36:21.455522 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-156f1203-9a77-4661-8d6a-9bd17d506d0e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:21.457711 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-156f1203-9a77-4661-8d6a-9bd17d506d0e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:21.466853 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-156f1203-9a77-4661-8d6a-9bd17d506d0e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:21.467794 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-156f1203-9a77-4661-8d6a-9bd17d506d0e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:21.468818 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-156f1203-9a77-4661-8d6a-9bd17d506d0e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:21.470520 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-156f1203-9a77-4661-8d6a-9bd17d506d0e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:21.471278 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-156f1203-9a77-4661-8d6a-9bd17d506d0e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:21.471925 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-156f1203-9a77-4661-8d6a-9bd17d506d0e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:21.493929 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a64c6eb3-c425-4ee7-afde-78c0cb6b3457 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:21.495404 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a64c6eb3-c425-4ee7-afde-78c0cb6b3457 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:21.507180 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a64c6eb3-c425-4ee7-afde-78c0cb6b3457 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:21.508699 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a64c6eb3-c425-4ee7-afde-78c0cb6b3457 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:21.509371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a64c6eb3-c425-4ee7-afde-78c0cb6b3457 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:21.510870 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a64c6eb3-c425-4ee7-afde-78c0cb6b3457 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:21.512043 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a64c6eb3-c425-4ee7-afde-78c0cb6b3457 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:21.513306 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a64c6eb3-c425-4ee7-afde-78c0cb6b3457 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:21.529794 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-156f1203-9a77-4661-8d6a-9bd17d506d0e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080026 Nov 02 07:36:21.530410 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 395/792] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 07:36:21 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 07:36:21.637051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9d4a3ca4-26fb-45d8-b66c-92448360f772 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:21.637814 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9d4a3ca4-26fb-45d8-b66c-92448360f772 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:21.647669 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9d4a3ca4-26fb-45d8-b66c-92448360f772 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:21.648177 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9d4a3ca4-26fb-45d8-b66c-92448360f772 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:21.648605 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9d4a3ca4-26fb-45d8-b66c-92448360f772 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:21.649320 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9d4a3ca4-26fb-45d8-b66c-92448360f772 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:21.649768 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9d4a3ca4-26fb-45d8-b66c-92448360f772 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:21.650197 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9d4a3ca4-26fb-45d8-b66c-92448360f772 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:21.716535 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9d4a3ca4-26fb-45d8-b66c-92448360f772 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Going to try to terminate instance {{(pid=118992) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:36:21.728095 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:21.799986 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a64c6eb3-c425-4ee7-afde-78c0cb6b3457 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:21.812751 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a64c6eb3-c425-4ee7-afde-78c0cb6b3457 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1266 microversion: 2.1 time: 0.323423 Nov 02 07:36:21.840522 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 398/793] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:21 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:21.863636 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9d4a3ca4-26fb-45d8-b66c-92448360f772 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 204 len: 0 microversion: 2.1 time: 0.229370 Nov 02 07:36:21.864821 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 396/794] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:36:21 2022] DELETE /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 07:36:21.872882 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-72d02f2e-209a-43fe-83c1-c12003e7213f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:21.873505 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-72d02f2e-209a-43fe-83c1-c12003e7213f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:21.880489 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-72d02f2e-209a-43fe-83c1-c12003e7213f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:21.881481 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-72d02f2e-209a-43fe-83c1-c12003e7213f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:21.882080 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-72d02f2e-209a-43fe-83c1-c12003e7213f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:21.882978 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-72d02f2e-209a-43fe-83c1-c12003e7213f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:21.883622 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-72d02f2e-209a-43fe-83c1-c12003e7213f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:21.884278 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-72d02f2e-209a-43fe-83c1-c12003e7213f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:22.090461 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-72d02f2e-209a-43fe-83c1-c12003e7213f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:22.099433 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-72d02f2e-209a-43fe-83c1-c12003e7213f tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1678 microversion: 2.1 time: 0.230422 Nov 02 07:36:22.100333 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 399/795] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:21 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:22.816925 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-fa243522-e4c3-4a5d-a175-0e748d391714 req-7c1c8cd8-1394-4956-ae03-58d06b8ce796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f0c6bc8-dd75-40d4-8aa9-db602c43827f", "name": "network-vif-plugged", "status": "completed", "tag": "a8803367-51f8-419d-a4e7-a51526460bb6"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:22.837029 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-789242cb-cf6a-4e47-9536-9ce087e3a632 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:22.837710 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-789242cb-cf6a-4e47-9536-9ce087e3a632 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:22.847592 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-789242cb-cf6a-4e47-9536-9ce087e3a632 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:22.848080 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-789242cb-cf6a-4e47-9536-9ce087e3a632 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:22.848517 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-789242cb-cf6a-4e47-9536-9ce087e3a632 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:22.850734 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-fa243522-e4c3-4a5d-a175-0e748d391714 req-7c1c8cd8-1394-4956-ae03-58d06b8ce796 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:22.851229 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-fa243522-e4c3-4a5d-a175-0e748d391714 req-7c1c8cd8-1394-4956-ae03-58d06b8ce796 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:22.851666 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-fa243522-e4c3-4a5d-a175-0e748d391714 req-7c1c8cd8-1394-4956-ae03-58d06b8ce796 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:22.854118 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-789242cb-cf6a-4e47-9536-9ce087e3a632 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:22.854628 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-789242cb-cf6a-4e47-9536-9ce087e3a632 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:22.855068 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-789242cb-cf6a-4e47-9536-9ce087e3a632 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:22.877274 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-fa243522-e4c3-4a5d-a175-0e748d391714 req-7c1c8cd8-1394-4956-ae03-58d06b8ce796 service nova] Creating event network-vif-plugged:a8803367-51f8-419d-a4e7-a51526460bb6 for instance 8f0c6bc8-dd75-40d4-8aa9-db602c43827f on hv-cinder-80473 Nov 02 07:36:22.883628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-fa243522-e4c3-4a5d-a175-0e748d391714 req-7c1c8cd8-1394-4956-ae03-58d06b8ce796 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081400 Nov 02 07:36:22.888935 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 397/796] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:36:23.088047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-789242cb-cf6a-4e47-9536-9ce087e3a632 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:23.104486 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-789242cb-cf6a-4e47-9536-9ce087e3a632 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1266 microversion: 2.1 time: 0.266892 Nov 02 07:36:23.105408 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 400/797] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:22 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:36:23.128078 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-01263cbb-4fb3-4e94-85e6-f033fe57340e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:23.129544 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-01263cbb-4fb3-4e94-85e6-f033fe57340e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:23.136861 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-01263cbb-4fb3-4e94-85e6-f033fe57340e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:23.137702 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-01263cbb-4fb3-4e94-85e6-f033fe57340e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:23.138383 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-01263cbb-4fb3-4e94-85e6-f033fe57340e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:23.139839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-01263cbb-4fb3-4e94-85e6-f033fe57340e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:23.140540 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-01263cbb-4fb3-4e94-85e6-f033fe57340e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:23.141728 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-01263cbb-4fb3-4e94-85e6-f033fe57340e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:23.454486 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-01263cbb-4fb3-4e94-85e6-f033fe57340e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:23.464389 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-01263cbb-4fb3-4e94-85e6-f033fe57340e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1678 microversion: 2.1 time: 0.343399 Nov 02 07:36:23.464954 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 398/798] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:23 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1678 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:23.789268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-69a57008-adb9-43eb-8f1c-83c3b971e1c3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Action: 'create', calling method: .version_select at 0x7f4d6a1d7430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-326555685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/IPR8i/GVtAhpSiq8lZvW6NYkqX7qgZ86LEvcPtvc+0Ac4nB/bZItXvY4kjCx/tl6nAl7yjAUDa4kmMqmH+opD5JnjY+bcyj+OrqA0lD9snTL+/mRMCZ6CsAL7YUA7Ug=="}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:23.825633 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-69a57008-adb9-43eb-8f1c-83c3b971e1c3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Getting quotas for project 280ce4c6b9174073902820e2e922bedf. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:36:23.833096 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-69a57008-adb9-43eb-8f1c-83c3b971e1c3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Getting quotas for user b0d0493e92b746eabdd4cb0912fa250c and project 280ce4c6b9174073902820e2e922bedf. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:36:23.900932 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-69a57008-adb9-43eb-8f1c-83c3b971e1c3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.115244 Nov 02 07:36:23.903032 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 401/799] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 07:36:23 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:36:24.108701 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1373569811", "imageRef": "2bc64970-5d6c-4d55-bd68-40283413aab7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-326555685", "networks": [{"uuid": "59746b03-2694-45ae-a6c9-a4cd96b42795"}]}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:24.133380 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-be729538-2f01-4b2f-b11a-ec0f7f9cad78 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:24.135161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-be729538-2f01-4b2f-b11a-ec0f7f9cad78 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:24.144781 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-be729538-2f01-4b2f-b11a-ec0f7f9cad78 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:24.145722 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-be729538-2f01-4b2f-b11a-ec0f7f9cad78 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:24.146728 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-be729538-2f01-4b2f-b11a-ec0f7f9cad78 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:24.147837 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-be729538-2f01-4b2f-b11a-ec0f7f9cad78 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:24.148523 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-be729538-2f01-4b2f-b11a-ec0f7f9cad78 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:24.149155 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-be729538-2f01-4b2f-b11a-ec0f7f9cad78 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:24.177524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.network.neutron [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] validate_networks() for [('59746b03-2694-45ae-a6c9-a4cd96b42795', None, None, None, None, None)] {{(pid=118992) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:36:24.663460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-be729538-2f01-4b2f-b11a-ec0f7f9cad78 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:24.677339 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-be729538-2f01-4b2f-b11a-ec0f7f9cad78 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1266 microversion: 2.1 time: 0.549237 Nov 02 07:36:24.679398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 402/800] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:24 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1266 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:36:24.695765 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a8630e3e-5a45-44cb-9284-9133d1a750c9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:24.696445 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a8630e3e-5a45-44cb-9284-9133d1a750c9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:24.704856 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8630e3e-5a45-44cb-9284-9133d1a750c9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:24.705578 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8630e3e-5a45-44cb-9284-9133d1a750c9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:24.706020 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8630e3e-5a45-44cb-9284-9133d1a750c9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:24.706808 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8630e3e-5a45-44cb-9284-9133d1a750c9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:24.707799 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8630e3e-5a45-44cb-9284-9133d1a750c9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:24.708426 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a8630e3e-5a45-44cb-9284-9133d1a750c9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:24.834374 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a8630e3e-5a45-44cb-9284-9133d1a750c9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:24.848254 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a8630e3e-5a45-44cb-9284-9133d1a750c9 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1611 microversion: 2.1 time: 0.156316 Nov 02 07:36:24.849872 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 403/801] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:24 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1611 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:25.225016 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Flavor limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:36:25.226091 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Image limits 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:36:25.226772 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Flavor pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:36:25.227345 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Image pref 0:0:0 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:36:25.227919 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.virt.hardware [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:36:25.246756 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:25.247515 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:25.248126 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:25.249672 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:25.249915 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:25.251514 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:25.303977 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Getting quotas for project 280ce4c6b9174073902820e2e922bedf. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:36:25.316108 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Getting quotas for user b0d0493e92b746eabdd4cb0912fa250c and project 280ce4c6b9174073902820e2e922bedf. Resources: {'ram', 'cores', 'instances'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:36:25.334109 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Going to run 1 instances... {{(pid=118992) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:36:25.336572 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2bc64970-5d6c-4d55-bd68-40283413aab7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:36:25.355728 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-40e2e623-b87a-4074-b2b6-68f047ac1e56 req-efecba82-bc9c-4097-b279-a4eba0ac7bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d", "name": "network-vif-deleted", "tag": "ad23ba36-b704-412e-8ee2-7d9ab9ce9ee2"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:25.373454 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-40e2e623-b87a-4074-b2b6-68f047ac1e56 req-efecba82-bc9c-4097-b279-a4eba0ac7bd4 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:25.374756 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-40e2e623-b87a-4074-b2b6-68f047ac1e56 req-efecba82-bc9c-4097-b279-a4eba0ac7bd4 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:25.375595 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-40e2e623-b87a-4074-b2b6-68f047ac1e56 req-efecba82-bc9c-4097-b279-a4eba0ac7bd4 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:25.394968 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-40e2e623-b87a-4074-b2b6-68f047ac1e56 req-efecba82-bc9c-4097-b279-a4eba0ac7bd4 service nova] Creating event network-vif-deleted:ad23ba36-b704-412e-8ee2-7d9ab9ce9ee2 for instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d on hv-cinder-80473 Nov 02 07:36:25.402075 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-40e2e623-b87a-4074-b2b6-68f047ac1e56 req-efecba82-bc9c-4097-b279-a4eba0ac7bd4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052635 Nov 02 07:36:25.405902 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 404/802] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:36:25.427121 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-b4762219-1a73-4076-9c14-daa12b3d6ddf tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.322119 Nov 02 07:36:25.428084 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 399/803] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:36:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 07:36:25.456259 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8f65ddf0-50ac-43d6-ae4a-07cc53a576bc tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:25.456963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8f65ddf0-50ac-43d6-ae4a-07cc53a576bc tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:25.582299 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8f65ddf0-50ac-43d6-ae4a-07cc53a576bc tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:25.597978 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8f65ddf0-50ac-43d6-ae4a-07cc53a576bc tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1258 microversion: 2.1 time: 0.156718 Nov 02 07:36:25.598855 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 405/804] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:25 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:25.707866 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f37d531f-1eeb-43f4-97f7-ac14cda8cf4a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:25.710784 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f37d531f-1eeb-43f4-97f7-ac14cda8cf4a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:25.743047 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f37d531f-1eeb-43f4-97f7-ac14cda8cf4a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:25.746153 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f37d531f-1eeb-43f4-97f7-ac14cda8cf4a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:25.748282 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f37d531f-1eeb-43f4-97f7-ac14cda8cf4a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:25.750119 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f37d531f-1eeb-43f4-97f7-ac14cda8cf4a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:25.751830 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f37d531f-1eeb-43f4-97f7-ac14cda8cf4a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:25.752277 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f37d531f-1eeb-43f4-97f7-ac14cda8cf4a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:25.875096 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-14a8cb9e-8de5-4344-a128-7f5ab15541da tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:25.876041 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-14a8cb9e-8de5-4344-a128-7f5ab15541da tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:25.886918 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-14a8cb9e-8de5-4344-a128-7f5ab15541da tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:25.887407 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-14a8cb9e-8de5-4344-a128-7f5ab15541da tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:25.887842 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-14a8cb9e-8de5-4344-a128-7f5ab15541da tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:25.888542 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-14a8cb9e-8de5-4344-a128-7f5ab15541da tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:25.888994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-14a8cb9e-8de5-4344-a128-7f5ab15541da tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:25.889412 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-14a8cb9e-8de5-4344-a128-7f5ab15541da tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:25.994279 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-14a8cb9e-8de5-4344-a128-7f5ab15541da tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:25.994808 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-14a8cb9e-8de5-4344-a128-7f5ab15541da tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:25.995242 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-14a8cb9e-8de5-4344-a128-7f5ab15541da tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:25.996054 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f37d531f-1eeb-43f4-97f7-ac14cda8cf4a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:26.001147 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.objects.instance [None req-14a8cb9e-8de5-4344-a128-7f5ab15541da tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lazy-loading 'fault' on Instance uuid 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d {{(pid=118991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:36:26.007009 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f37d531f-1eeb-43f4-97f7-ac14cda8cf4a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1454 microversion: 2.1 time: 0.309376 Nov 02 07:36:26.022950 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 400/805] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:25 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1454 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:26.028946 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:26.037128 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-50118f6a-4093-4cfb-bba0-04e1ec78296f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:26.038038 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-50118f6a-4093-4cfb-bba0-04e1ec78296f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:26.049368 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-50118f6a-4093-4cfb-bba0-04e1ec78296f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:26.051654 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-50118f6a-4093-4cfb-bba0-04e1ec78296f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:26.052604 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-50118f6a-4093-4cfb-bba0-04e1ec78296f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:26.054977 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-50118f6a-4093-4cfb-bba0-04e1ec78296f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:26.056834 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-50118f6a-4093-4cfb-bba0-04e1ec78296f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:26.058709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-50118f6a-4093-4cfb-bba0-04e1ec78296f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:26.137899 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-14a8cb9e-8de5-4344-a128-7f5ab15541da tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47965dc7f5964bbfa4efff0822530965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3bab98d31d49098a8e7242d51be646', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:26.151265 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-14a8cb9e-8de5-4344-a128-7f5ab15541da tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 200 len: 1330 microversion: 2.1 time: 0.282181 Nov 02 07:36:26.167234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 406/806] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:25 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 1330 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:36:26.363861 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-50118f6a-4093-4cfb-bba0-04e1ec78296f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:26.372149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-50118f6a-4093-4cfb-bba0-04e1ec78296f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1454 microversion: 2.1 time: 0.340663 Nov 02 07:36:26.373644 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 401/807] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:26 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1454 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:36:26.625886 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-b34ce98b-5ef6-459f-8e6b-0f4dfe24dd81 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:26.626932 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-b34ce98b-5ef6-459f-8e6b-0f4dfe24dd81 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:26.640032 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b34ce98b-5ef6-459f-8e6b-0f4dfe24dd81 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:26.642210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b34ce98b-5ef6-459f-8e6b-0f4dfe24dd81 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:26.643006 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b34ce98b-5ef6-459f-8e6b-0f4dfe24dd81 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:26.645600 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b34ce98b-5ef6-459f-8e6b-0f4dfe24dd81 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:26.646316 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b34ce98b-5ef6-459f-8e6b-0f4dfe24dd81 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:26.648753 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b34ce98b-5ef6-459f-8e6b-0f4dfe24dd81 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:26.783721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-b34ce98b-5ef6-459f-8e6b-0f4dfe24dd81 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:26.794938 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-b34ce98b-5ef6-459f-8e6b-0f4dfe24dd81 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1254 microversion: 2.1 time: 0.174558 Nov 02 07:36:26.795976 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 402/808] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:26 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1254 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:26.848130 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-44734276-f210-4737-a035-e80e28f2d88e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Action: 'create', calling method: .version_select at 0x7f4d6a1da940>, body: {"keypair": {"name": "tempest-keypair-876311742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyWuzUGTNeFj5Oky9KUr3gVmdD1eE3Ez+1Hh2+IOjVV9jYTaOWFvuhadC7i23FkNQO5Ljeb0u+kEozEw+opF9o69IC98hPHreWRdBMkhmfxfvG/hI1GyAsOsWBZ+/bSvA=="}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:26.889304 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-44734276-f210-4737-a035-e80e28f2d88e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Getting quotas for project 86cca0dcb21a47e483458b36e33f5036. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:36:26.902065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-44734276-f210-4737-a035-e80e28f2d88e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Getting quotas for user 33c63dc278ac4eb79d2a4553fcbeda4f and project 86cca0dcb21a47e483458b36e33f5036. Resources: {'key_pairs'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:36:26.946144 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-44734276-f210-4737-a035-e80e28f2d88e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.379744 Nov 02 07:36:26.955262 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 407/809] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 07:36:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:36:27.189661 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a80d7923-b4fb-4d3f-9ad3-9f20e49c2f87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:27.194621 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a80d7923-b4fb-4d3f-9ad3-9f20e49c2f87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:27.212091 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a80d7923-b4fb-4d3f-9ad3-9f20e49c2f87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:27.212893 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a80d7923-b4fb-4d3f-9ad3-9f20e49c2f87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:27.213729 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a80d7923-b4fb-4d3f-9ad3-9f20e49c2f87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:27.214653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a80d7923-b4fb-4d3f-9ad3-9f20e49c2f87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:27.215477 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a80d7923-b4fb-4d3f-9ad3-9f20e49c2f87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:27.216092 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a80d7923-b4fb-4d3f-9ad3-9f20e49c2f87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:27.236816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-a80d7923-b4fb-4d3f-9ad3-9f20e49c2f87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] HTTP exception thrown: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a80d7923-b4fb-4d3f-9ad3-9f20e49c2f87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Request method failure captured: Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d HTTP/1.1 Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhytX4Fqrx49tZr8XMSeqOuiVVe5QhR5pSkx822MlHR1MwQprRFdpyDwzWSFm2fCfS3S5s_QIudHlvHUSGGla4ObJvPgMlXRPp30GlwXPuRdB_YwvXPaPkzMw2fsaqcBcgnloHZe9knHcPTV7sOfEXdhYljLTd7gzyDjmltPZHCDm9w Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:36:27.238716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:36:27.240237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba3bab98d31d49098a8e7242d51be646", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:36:27.240237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:27.240237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:27.240237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:27.240237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:27.240237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:36:27.240237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:36:27.240237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 47965dc7f5964bbfa4efff0822530965 Nov 02 07:36:27.240237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:27.240237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:36:27.240237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. Nov 02 07:36:27.240237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d'} Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:36:27.241020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. Nov 02 07:36:27.242489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:27.244497 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a80d7923-b4fb-4d3f-9ad3-9f20e49c2f87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Returning 404 to user: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:36:27.245353 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a80d7923-b4fb-4d3f-9ad3-9f20e49c2f87 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 404 len: 111 microversion: 2.1 time: 0.068820 Nov 02 07:36:27.245950 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 403/810] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:27 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:36:27.255630 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0678f449-aca1-48c2-9ab9-c0dde5e6b320 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '.version_select at 0x7f4d6a2a3ee0>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:27.280899 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0678f449-aca1-48c2-9ab9-c0dde5e6b320 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-152485710" status: 202 len: 0 microversion: 2.1 time: 0.028842 Nov 02 07:36:27.286172 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 408/811] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 07:36:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-152485710 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:36:27.828875 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-fbfd6a62-e47d-4ae0-a332-cd074f5fb69b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:27.829499 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-fbfd6a62-e47d-4ae0-a332-cd074f5fb69b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:27.842940 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fbfd6a62-e47d-4ae0-a332-cd074f5fb69b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:27.846218 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fbfd6a62-e47d-4ae0-a332-cd074f5fb69b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:27.849341 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fbfd6a62-e47d-4ae0-a332-cd074f5fb69b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:27.851567 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fbfd6a62-e47d-4ae0-a332-cd074f5fb69b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:27.852822 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fbfd6a62-e47d-4ae0-a332-cd074f5fb69b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:27.853911 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fbfd6a62-e47d-4ae0-a332-cd074f5fb69b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:28.036627 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fbfd6a62-e47d-4ae0-a332-cd074f5fb69b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:28.045975 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-fbfd6a62-e47d-4ae0-a332-cd074f5fb69b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1316 microversion: 2.1 time: 0.225084 Nov 02 07:36:28.050800 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 404/812] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:27 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:29.070645 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-4b00dd69-9fea-45d7-82c7-b9e57399aca3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:29.072260 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-4b00dd69-9fea-45d7-82c7-b9e57399aca3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:29.084445 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4b00dd69-9fea-45d7-82c7-b9e57399aca3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:29.085524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4b00dd69-9fea-45d7-82c7-b9e57399aca3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:29.086200 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4b00dd69-9fea-45d7-82c7-b9e57399aca3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:29.090317 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4b00dd69-9fea-45d7-82c7-b9e57399aca3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:29.091098 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4b00dd69-9fea-45d7-82c7-b9e57399aca3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:29.091769 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4b00dd69-9fea-45d7-82c7-b9e57399aca3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:29.347672 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-842c8759-7af8-4a7c-9cbb-9eafb8027f08 req-d2986142-7f6f-4951-a628-71fc5da8a393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f0c6bc8-dd75-40d4-8aa9-db602c43827f", "tag": "a8803367-51f8-419d-a4e7-a51526460bb6"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:29.360650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-842c8759-7af8-4a7c-9cbb-9eafb8027f08 req-d2986142-7f6f-4951-a628-71fc5da8a393 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:29.361881 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-842c8759-7af8-4a7c-9cbb-9eafb8027f08 req-d2986142-7f6f-4951-a628-71fc5da8a393 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:29.362559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-842c8759-7af8-4a7c-9cbb-9eafb8027f08 req-d2986142-7f6f-4951-a628-71fc5da8a393 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:29.377623 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-842c8759-7af8-4a7c-9cbb-9eafb8027f08 req-d2986142-7f6f-4951-a628-71fc5da8a393 service nova] Creating event network-changed:a8803367-51f8-419d-a4e7-a51526460bb6 for instance 8f0c6bc8-dd75-40d4-8aa9-db602c43827f on hv-cinder-80473 Nov 02 07:36:29.384946 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-842c8759-7af8-4a7c-9cbb-9eafb8027f08 req-d2986142-7f6f-4951-a628-71fc5da8a393 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041777 Nov 02 07:36:29.391195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 405/813] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:36:29.640240 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-4b00dd69-9fea-45d7-82c7-b9e57399aca3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:29.649975 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-4b00dd69-9fea-45d7-82c7-b9e57399aca3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1316 microversion: 2.1 time: 0.584015 Nov 02 07:36:29.662168 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 409/814] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:29 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1316 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:30.696700 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-52678b79-1267-4497-814e-23f52451d43f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:30.697408 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-52678b79-1267-4497-814e-23f52451d43f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:30.722066 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-52678b79-1267-4497-814e-23f52451d43f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:30.722872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-52678b79-1267-4497-814e-23f52451d43f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:30.726933 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-52678b79-1267-4497-814e-23f52451d43f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:30.727621 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-52678b79-1267-4497-814e-23f52451d43f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:30.728865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-52678b79-1267-4497-814e-23f52451d43f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:30.729482 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-52678b79-1267-4497-814e-23f52451d43f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:31.433456 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-683c8b56-0e0e-4978-8d0d-de85ff8ced43 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:31.435240 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-683c8b56-0e0e-4978-8d0d-de85ff8ced43 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:31.460933 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-683c8b56-0e0e-4978-8d0d-de85ff8ced43 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:31.462986 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-683c8b56-0e0e-4978-8d0d-de85ff8ced43 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:31.465731 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-683c8b56-0e0e-4978-8d0d-de85ff8ced43 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:31.470550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-683c8b56-0e0e-4978-8d0d-de85ff8ced43 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:31.476230 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-683c8b56-0e0e-4978-8d0d-de85ff8ced43 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:31.477513 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-683c8b56-0e0e-4978-8d0d-de85ff8ced43 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:31.515316 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-683c8b56-0e0e-4978-8d0d-de85ff8ced43 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] HTTP exception thrown: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-683c8b56-0e0e-4978-8d0d-de85ff8ced43 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Request method failure captured: Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: DELETE /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d HTTP/1.1 Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhytX4Fqrx49tZr8XMSeqOuiVVe5QhR5pSkx822MlHR1MwQprRFdpyDwzWSFm2fCfS3S5s_QIudHlvHUSGGla4ObJvPgMlXRPp30GlwXPuRdB_YwvXPaPkzMw2fsaqcBcgnloHZe9knHcPTV7sOfEXdhYljLTd7gzyDjmltPZHCDm9w Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:36:31.518194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:36:31.519780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba3bab98d31d49098a8e7242d51be646", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:36:31.519780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:31.519780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:31.519780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:31.519780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:31.519780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:36:31.519780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:36:31.519780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 47965dc7f5964bbfa4efff0822530965 Nov 02 07:36:31.519780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:31.519780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:36:31.519780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. Nov 02 07:36:31.519780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': '01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d'} Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:36:31.520677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. Nov 02 07:36:31.522110 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:31.527148 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-683c8b56-0e0e-4978-8d0d-de85ff8ced43 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Returning 404 to user: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:36:31.528258 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-683c8b56-0e0e-4978-8d0d-de85ff8ced43 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 404 len: 111 microversion: 2.1 time: 0.098917 Nov 02 07:36:31.531306 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 410/815] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:36:31 2022] DELETE /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 07:36:31.541550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f1cf8bbb-7cff-4deb-8f34-af4ffce8c12c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:31.544304 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f1cf8bbb-7cff-4deb-8f34-af4ffce8c12c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:31.572185 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f1cf8bbb-7cff-4deb-8f34-af4ffce8c12c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:31.572677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f1cf8bbb-7cff-4deb-8f34-af4ffce8c12c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:31.573115 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f1cf8bbb-7cff-4deb-8f34-af4ffce8c12c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:31.573914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f1cf8bbb-7cff-4deb-8f34-af4ffce8c12c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:31.574277 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f1cf8bbb-7cff-4deb-8f34-af4ffce8c12c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:31.579130 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f1cf8bbb-7cff-4deb-8f34-af4ffce8c12c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:31.627065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-f1cf8bbb-7cff-4deb-8f34-af4ffce8c12c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] HTTP exception thrown: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f1cf8bbb-7cff-4deb-8f34-af4ffce8c12c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Request method failure captured: Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d HTTP/1.1 Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhytX4Fqrx49tZr8XMSeqOuiVVe5QhR5pSkx822MlHR1MwQprRFdpyDwzWSFm2fCfS3S5s_QIudHlvHUSGGla4ObJvPgMlXRPp30GlwXPuRdB_YwvXPaPkzMw2fsaqcBcgnloHZe9knHcPTV7sOfEXdhYljLTd7gzyDjmltPZHCDm9w Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:36:31.628956 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:36:31.630283 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba3bab98d31d49098a8e7242d51be646", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:36:31.630283 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:31.630283 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:31.630283 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:31.630283 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:31.630283 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:36:31.630283 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:36:31.630283 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 47965dc7f5964bbfa4efff0822530965 Nov 02 07:36:31.630283 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:31.630283 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:36:31.630283 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. Nov 02 07:36:31.630283 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': '01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d'} Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:36:31.631163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. Nov 02 07:36:31.632631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:31.637452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f1cf8bbb-7cff-4deb-8f34-af4ffce8c12c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Returning 404 to user: Instance 01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:36:31.637452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f1cf8bbb-7cff-4deb-8f34-af4ffce8c12c tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d" status: 404 len: 111 microversion: 2.1 time: 0.100874 Nov 02 07:36:31.645817 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 411/816] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:31 2022] GET /compute/v2.1/servers/01dc4b25-a0e4-458e-8e9b-44ecfea6ba2d => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 07:36:31.691559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-52678b79-1267-4497-814e-23f52451d43f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:31.708472 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-52678b79-1267-4497-814e-23f52451d43f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1358 microversion: 2.1 time: 1.013789 Nov 02 07:36:31.710848 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 406/817] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:30 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1358 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:32.524974 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-665165345", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c6f85dd-45ed-4684-846a-c63750ac56e2"}], "security_groups": [{"name": "tempest-securitygroup--818963103"}], "key_name": "tempest-keypair-876311742", "user_data": "}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:32.736561 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3780acd7-bd68-47ae-99ee-55e692e93290 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:32.737331 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3780acd7-bd68-47ae-99ee-55e692e93290 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:32.757901 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3780acd7-bd68-47ae-99ee-55e692e93290 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:32.762068 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3780acd7-bd68-47ae-99ee-55e692e93290 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:32.762795 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3780acd7-bd68-47ae-99ee-55e692e93290 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:32.763656 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3780acd7-bd68-47ae-99ee-55e692e93290 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:32.764230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3780acd7-bd68-47ae-99ee-55e692e93290 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:32.764847 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3780acd7-bd68-47ae-99ee-55e692e93290 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:32.788561 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.network.neutron [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] validate_networks() for [('5c6f85dd-45ed-4684-846a-c63750ac56e2', None, None, None, None, None)] {{(pid=118991) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:36:33.153342 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3780acd7-bd68-47ae-99ee-55e692e93290 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:33.168948 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3780acd7-bd68-47ae-99ee-55e692e93290 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1358 microversion: 2.1 time: 0.437231 Nov 02 07:36:33.181120 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 407/818] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:32 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1358 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:33.187271 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-335f2ca4-fc85-415e-a2d9-a3b8b95ebae1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:33.187704 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-335f2ca4-fc85-415e-a2d9-a3b8b95ebae1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:33.202845 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-335f2ca4-fc85-415e-a2d9-a3b8b95ebae1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:33.203700 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-335f2ca4-fc85-415e-a2d9-a3b8b95ebae1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:33.204389 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-335f2ca4-fc85-415e-a2d9-a3b8b95ebae1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:33.207316 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-335f2ca4-fc85-415e-a2d9-a3b8b95ebae1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:33.209548 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-335f2ca4-fc85-415e-a2d9-a3b8b95ebae1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:33.210186 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-335f2ca4-fc85-415e-a2d9-a3b8b95ebae1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:33.244464 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-335f2ca4-fc85-415e-a2d9-a3b8b95ebae1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] HTTP exception thrown: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-335f2ca4-fc85-415e-a2d9-a3b8b95ebae1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Request method failure captured: Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: DELETE /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 HTTP/1.1 Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhytX4Fqrx49tZr8XMSeqOuiVVe5QhR5pSkx822MlHR1MwQprRFdpyDwzWSFm2fCfS3S5s_QIudHlvHUSGGla4ObJvPgMlXRPp30GlwXPuRdB_YwvXPaPkzMw2fsaqcBcgnloHZe9knHcPTV7sOfEXdhYljLTd7gzyDjmltPZHCDm9w Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:36:33.258210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:36:33.259767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba3bab98d31d49098a8e7242d51be646", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:36:33.259767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:33.259767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:33.259767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:33.259767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:33.259767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:36:33.259767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:36:33.259767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 47965dc7f5964bbfa4efff0822530965 Nov 02 07:36:33.259767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:33.259767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:36:33.259767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. Nov 02 07:36:33.259767 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '7bd1bfac-3396-4f20-bb69-0ce371638a22'} Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:36:33.260655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. Nov 02 07:36:33.262195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.263708 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:33.264648 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-335f2ca4-fc85-415e-a2d9-a3b8b95ebae1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Returning 404 to user: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:36:33.265844 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-335f2ca4-fc85-415e-a2d9-a3b8b95ebae1 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 404 len: 111 microversion: 2.1 time: 0.083304 Nov 02 07:36:33.266939 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 408/819] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:36:33 2022] DELETE /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:36:33.272479 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-20788cdf-128d-497d-abe1-7552b7957c4b req-68ee6094-3975-4645-bf85-7c17db83aef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8", "tag": "33ad81f7-86a8-4d84-8799-f57ab596e5c4"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:33.292326 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-20788cdf-128d-497d-abe1-7552b7957c4b req-68ee6094-3975-4645-bf85-7c17db83aef2 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:33.293036 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-20788cdf-128d-497d-abe1-7552b7957c4b req-68ee6094-3975-4645-bf85-7c17db83aef2 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:33.293910 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-20788cdf-128d-497d-abe1-7552b7957c4b req-68ee6094-3975-4645-bf85-7c17db83aef2 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:33.327406 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-20788cdf-128d-497d-abe1-7552b7957c4b req-68ee6094-3975-4645-bf85-7c17db83aef2 service nova] Creating event network-changed:33ad81f7-86a8-4d84-8799-f57ab596e5c4 for instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 on hv-cinder-80473 Nov 02 07:36:33.336060 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-20788cdf-128d-497d-abe1-7552b7957c4b req-68ee6094-3975-4645-bf85-7c17db83aef2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067640 Nov 02 07:36:33.336809 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 409/820] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:36:33.344825 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6b026a7b-f51e-4d42-9f6a-03736e362e41 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:33.355378 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-6b026a7b-f51e-4d42-9f6a-03736e362e41 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 7bd1bfac-3396-4f20-bb69-0ce371638a22] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:33.367252 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6b026a7b-f51e-4d42-9f6a-03736e362e41 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:33.367749 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6b026a7b-f51e-4d42-9f6a-03736e362e41 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:33.368179 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6b026a7b-f51e-4d42-9f6a-03736e362e41 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:33.369079 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6b026a7b-f51e-4d42-9f6a-03736e362e41 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:33.369553 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6b026a7b-f51e-4d42-9f6a-03736e362e41 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:33.369979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6b026a7b-f51e-4d42-9f6a-03736e362e41 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:33.395946 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-6b026a7b-f51e-4d42-9f6a-03736e362e41 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] HTTP exception thrown: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6b026a7b-f51e-4d42-9f6a-03736e362e41 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Request method failure captured: Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 HTTP/1.1 Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhytX4Fqrx49tZr8XMSeqOuiVVe5QhR5pSkx822MlHR1MwQprRFdpyDwzWSFm2fCfS3S5s_QIudHlvHUSGGla4ObJvPgMlXRPp30GlwXPuRdB_YwvXPaPkzMw2fsaqcBcgnloHZe9knHcPTV7sOfEXdhYljLTd7gzyDjmltPZHCDm9w Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:36:33.397593 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:36:33.399398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba3bab98d31d49098a8e7242d51be646", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:36:33.399398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:33.399398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:33.399398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:33.399398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:33.399398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:36:33.399398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:36:33.399398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 47965dc7f5964bbfa4efff0822530965 Nov 02 07:36:33.399398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:33.399398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:36:33.399398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. Nov 02 07:36:33.399398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '7bd1bfac-3396-4f20-bb69-0ce371638a22'} Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:36:33.400344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. Nov 02 07:36:33.402149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.403587 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6b026a7b-f51e-4d42-9f6a-03736e362e41 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Returning 404 to user: Instance 7bd1bfac-3396-4f20-bb69-0ce371638a22 could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:36:33.403764 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-6b026a7b-f51e-4d42-9f6a-03736e362e41 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22" status: 404 len: 111 microversion: 2.1 time: 0.065639 Nov 02 07:36:33.406681 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 410/821] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:33 2022] GET /compute/v2.1/servers/7bd1bfac-3396-4f20-bb69-0ce371638a22 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:36:33.413943 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-edbc270a-8123-44f8-a071-7181d1357818 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:33.414611 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-edbc270a-8123-44f8-a071-7181d1357818 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:33.421033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-edbc270a-8123-44f8-a071-7181d1357818 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:33.421861 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-edbc270a-8123-44f8-a071-7181d1357818 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:33.423087 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-edbc270a-8123-44f8-a071-7181d1357818 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:33.423924 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-edbc270a-8123-44f8-a071-7181d1357818 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:33.424485 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-edbc270a-8123-44f8-a071-7181d1357818 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:33.425018 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-edbc270a-8123-44f8-a071-7181d1357818 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:33.452849 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-edbc270a-8123-44f8-a071-7181d1357818 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] HTTP exception thrown: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-edbc270a-8123-44f8-a071-7181d1357818 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Request method failure captured: Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: DELETE /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 HTTP/1.1 Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhytX4Fqrx49tZr8XMSeqOuiVVe5QhR5pSkx822MlHR1MwQprRFdpyDwzWSFm2fCfS3S5s_QIudHlvHUSGGla4ObJvPgMlXRPp30GlwXPuRdB_YwvXPaPkzMw2fsaqcBcgnloHZe9knHcPTV7sOfEXdhYljLTd7gzyDjmltPZHCDm9w Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:36:33.455222 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:36:33.456774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba3bab98d31d49098a8e7242d51be646", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:36:33.456774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:33.456774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:33.456774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:33.456774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:33.456774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:36:33.456774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:36:33.456774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 47965dc7f5964bbfa4efff0822530965 Nov 02 07:36:33.456774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:33.456774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:36:33.456774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. Nov 02 07:36:33.456774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': 'b9a9cfaf-8301-4add-a31e-805734cc8ad3'} Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:36:33.457637 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. Nov 02 07:36:33.459112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.460536 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-edbc270a-8123-44f8-a071-7181d1357818 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Returning 404 to user: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:36:33.461253 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-edbc270a-8123-44f8-a071-7181d1357818 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 404 len: 111 microversion: 2.1 time: 0.051648 Nov 02 07:36:33.464217 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 411/822] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:36:33 2022] DELETE /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 07:36:33.471272 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-78783a37-4fe1-44dd-abb5-bce3d8a06729 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:33.472170 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-78783a37-4fe1-44dd-abb5-bce3d8a06729 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: b9a9cfaf-8301-4add-a31e-805734cc8ad3] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:33.478740 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:33.480547 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-78783a37-4fe1-44dd-abb5-bce3d8a06729 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:33.481263 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-78783a37-4fe1-44dd-abb5-bce3d8a06729 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:33.481949 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-78783a37-4fe1-44dd-abb5-bce3d8a06729 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:33.482906 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-78783a37-4fe1-44dd-abb5-bce3d8a06729 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:33.483667 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-78783a37-4fe1-44dd-abb5-bce3d8a06729 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:33.484342 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-78783a37-4fe1-44dd-abb5-bce3d8a06729 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:33.502261 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-78783a37-4fe1-44dd-abb5-bce3d8a06729 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] HTTP exception thrown: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-78783a37-4fe1-44dd-abb5-bce3d8a06729 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Request method failure captured: Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 HTTP/1.1 Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhytX4Fqrx49tZr8XMSeqOuiVVe5QhR5pSkx822MlHR1MwQprRFdpyDwzWSFm2fCfS3S5s_QIudHlvHUSGGla4ObJvPgMlXRPp30GlwXPuRdB_YwvXPaPkzMw2fsaqcBcgnloHZe9knHcPTV7sOfEXdhYljLTd7gzyDjmltPZHCDm9w Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:36:33.503941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:36:33.505441 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba3bab98d31d49098a8e7242d51be646", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:36:33.505441 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:33.505441 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:33.505441 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:33.505441 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:33.505441 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:36:33.505441 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:36:33.505441 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 47965dc7f5964bbfa4efff0822530965 Nov 02 07:36:33.505441 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:33.505441 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:36:33.505441 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. Nov 02 07:36:33.505441 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': 'b9a9cfaf-8301-4add-a31e-805734cc8ad3'} Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:36:33.506159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. Nov 02 07:36:33.508736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:33.511084 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-78783a37-4fe1-44dd-abb5-bce3d8a06729 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Returning 404 to user: Instance b9a9cfaf-8301-4add-a31e-805734cc8ad3 could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:36:33.511084 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-78783a37-4fe1-44dd-abb5-bce3d8a06729 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3" status: 404 len: 111 microversion: 2.1 time: 0.038951 Nov 02 07:36:33.511084 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 412/823] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:33 2022] GET /compute/v2.1/servers/b9a9cfaf-8301-4add-a31e-805734cc8ad3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 07:36:33.539385 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Flavor limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:36:33.539864 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Image limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:36:33.540331 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Flavor pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:36:33.540749 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Image pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:36:33.541160 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:36:33.559499 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:33.560098 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:33.560631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:33.561362 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:33.561796 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:33.562745 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:33.588239 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Getting quotas for project 86cca0dcb21a47e483458b36e33f5036. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:36:33.597134 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Getting quotas for user 33c63dc278ac4eb79d2a4553fcbeda4f and project 86cca0dcb21a47e483458b36e33f5036. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:36:33.633488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Going to run 1 instances... {{(pid=118991) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:36:33.636625 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:36:33.709491 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-eb745bc3-c3ae-4ede-8f7c-f1570018449c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.189560 Nov 02 07:36:33.714290 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 412/824] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:36:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 07:36:33.726626 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6fb4340c-e7c3-415d-8eba-eb9b6b3dfc8b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:33.727598 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-6fb4340c-e7c3-415d-8eba-eb9b6b3dfc8b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:33.791079 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-6fb4340c-e7c3-415d-8eba-eb9b6b3dfc8b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:33.800037 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-6fb4340c-e7c3-415d-8eba-eb9b6b3dfc8b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1236 microversion: 2.1 time: 0.077809 Nov 02 07:36:33.800615 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 413/825] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:33 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:34.194777 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-4b8917b3-8935-40fe-9a9a-f8512dd6587e tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:34.195339 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-4b8917b3-8935-40fe-9a9a-f8512dd6587e tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:34.206714 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4b8917b3-8935-40fe-9a9a-f8512dd6587e tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:34.207176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4b8917b3-8935-40fe-9a9a-f8512dd6587e tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:34.207620 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4b8917b3-8935-40fe-9a9a-f8512dd6587e tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:34.208530 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4b8917b3-8935-40fe-9a9a-f8512dd6587e tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:34.208981 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4b8917b3-8935-40fe-9a9a-f8512dd6587e tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:34.209401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4b8917b3-8935-40fe-9a9a-f8512dd6587e tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:34.349818 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-4b8917b3-8935-40fe-9a9a-f8512dd6587e tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:34.357739 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-4b8917b3-8935-40fe-9a9a-f8512dd6587e tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1358 microversion: 2.1 time: 0.166730 Nov 02 07:36:34.358738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 413/826] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:34 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:34.710740 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d02b1e79-3dec-4e13-bf04-bfc8e6ff3e89 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:34.711265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-d02b1e79-3dec-4e13-bf04-bfc8e6ff3e89 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:34.718729 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d02b1e79-3dec-4e13-bf04-bfc8e6ff3e89 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:34.719224 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d02b1e79-3dec-4e13-bf04-bfc8e6ff3e89 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:34.719662 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d02b1e79-3dec-4e13-bf04-bfc8e6ff3e89 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:34.720367 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d02b1e79-3dec-4e13-bf04-bfc8e6ff3e89 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:34.720818 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d02b1e79-3dec-4e13-bf04-bfc8e6ff3e89 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:34.721241 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d02b1e79-3dec-4e13-bf04-bfc8e6ff3e89 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:34.735306 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-d02b1e79-3dec-4e13-bf04-bfc8e6ff3e89 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] HTTP exception thrown: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d02b1e79-3dec-4e13-bf04-bfc8e6ff3e89 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Request method failure captured: Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: DELETE /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab HTTP/1.1 Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhytX4Fqrx49tZr8XMSeqOuiVVe5QhR5pSkx822MlHR1MwQprRFdpyDwzWSFm2fCfS3S5s_QIudHlvHUSGGla4ObJvPgMlXRPp30GlwXPuRdB_YwvXPaPkzMw2fsaqcBcgnloHZe9knHcPTV7sOfEXdhYljLTd7gzyDjmltPZHCDm9w Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:36:34.737452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:36:34.739228 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba3bab98d31d49098a8e7242d51be646", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:36:34.739228 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:34.739228 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:34.739228 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:34.739228 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:34.739228 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:36:34.739228 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:36:34.739228 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 47965dc7f5964bbfa4efff0822530965 Nov 02 07:36:34.739228 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:34.739228 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:36:34.739228 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. Nov 02 07:36:34.739228 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '793f8cfa-443a-4695-861e-6ba4c4e441ab'} Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:36:34.740144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. Nov 02 07:36:34.741650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:36:34.743177 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d02b1e79-3dec-4e13-bf04-bfc8e6ff3e89 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Returning 404 to user: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:36:34.743316 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-d02b1e79-3dec-4e13-bf04-bfc8e6ff3e89 tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "DELETE /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 404 len: 111 microversion: 2.1 time: 0.036552 Nov 02 07:36:34.747060 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 414/827] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:36:34 2022] DELETE /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:36:34.752857 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-435ff1b6-4366-4c7b-a171-559cd6a9120e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:34.753464 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-435ff1b6-4366-4c7b-a171-559cd6a9120e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] [instance: 793f8cfa-443a-4695-861e-6ba4c4e441ab] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:34.760198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-435ff1b6-4366-4c7b-a171-559cd6a9120e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:34.761137 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-435ff1b6-4366-4c7b-a171-559cd6a9120e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:34.761137 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-435ff1b6-4366-4c7b-a171-559cd6a9120e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:34.761756 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-435ff1b6-4366-4c7b-a171-559cd6a9120e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:34.762200 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-435ff1b6-4366-4c7b-a171-559cd6a9120e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:34.762660 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-435ff1b6-4366-4c7b-a171-559cd6a9120e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:34.777115 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-435ff1b6-4366-4c7b-a171-559cd6a9120e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] HTTP exception thrown: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-435ff1b6-4366-4c7b-a171-559cd6a9120e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Request method failure captured: Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab HTTP/1.1 Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhytX4Fqrx49tZr8XMSeqOuiVVe5QhR5pSkx822MlHR1MwQprRFdpyDwzWSFm2fCfS3S5s_QIudHlvHUSGGla4ObJvPgMlXRPp30GlwXPuRdB_YwvXPaPkzMw2fsaqcBcgnloHZe9knHcPTV7sOfEXdhYljLTd7gzyDjmltPZHCDm9w Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:36:34.778678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:36:34.780079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ba3bab98d31d49098a8e7242d51be646", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ba3bab98d31d49098a8e7242d51be646"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:36:34.780079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:34.780079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: ba3bab98d31d49098a8e7242d51be646 Nov 02 07:36:34.780079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1808551701 Nov 02 07:36:34.780079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:34.780079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:36:34.780079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:36:34.780079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 47965dc7f5964bbfa4efff0822530965 Nov 02 07:36:34.780079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-AttachVolumeNegativeTest-1808551701-project Nov 02 07:36:34.780079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:36:34.780079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. Nov 02 07:36:34.780079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': '793f8cfa-443a-4695-861e-6ba4c4e441ab'} Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:36:34.784698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. Nov 02 07:36:34.787229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:36:34.789947 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-435ff1b6-4366-4c7b-a171-559cd6a9120e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] Returning 404 to user: Instance 793f8cfa-443a-4695-861e-6ba4c4e441ab could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:36:34.789947 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-435ff1b6-4366-4c7b-a171-559cd6a9120e tempest-AttachVolumeNegativeTest-1808551701 tempest-AttachVolumeNegativeTest-1808551701-project] 10.222.0.18 "GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab" status: 404 len: 111 microversion: 2.1 time: 0.031856 Nov 02 07:36:34.789947 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 414/828] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:34 2022] GET /compute/v2.1/servers/793f8cfa-443a-4695-861e-6ba4c4e441ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:36:34.824124 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-feedd5de-8e75-478d-bed7-ef47751a6dcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:34.824852 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-feedd5de-8e75-478d-bed7-ef47751a6dcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:34.836798 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-feedd5de-8e75-478d-bed7-ef47751a6dcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:34.838302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-feedd5de-8e75-478d-bed7-ef47751a6dcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:34.842202 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-feedd5de-8e75-478d-bed7-ef47751a6dcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:34.843071 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-feedd5de-8e75-478d-bed7-ef47751a6dcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:34.843617 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-feedd5de-8e75-478d-bed7-ef47751a6dcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:34.844129 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-feedd5de-8e75-478d-bed7-ef47751a6dcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:34.918020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-feedd5de-8e75-478d-bed7-ef47751a6dcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:34.926609 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-feedd5de-8e75-478d-bed7-ef47751a6dcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1240 microversion: 2.1 time: 0.106531 Nov 02 07:36:34.927496 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 415/829] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:34 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1240 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:35.382531 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a645aa25-c372-4cf4-8bf3-1ae231f3f4d6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:35.383184 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a645aa25-c372-4cf4-8bf3-1ae231f3f4d6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:35.389057 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a645aa25-c372-4cf4-8bf3-1ae231f3f4d6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:35.389531 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a645aa25-c372-4cf4-8bf3-1ae231f3f4d6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:35.389964 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a645aa25-c372-4cf4-8bf3-1ae231f3f4d6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:35.390672 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a645aa25-c372-4cf4-8bf3-1ae231f3f4d6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:35.391167 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a645aa25-c372-4cf4-8bf3-1ae231f3f4d6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:35.391748 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a645aa25-c372-4cf4-8bf3-1ae231f3f4d6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:35.541193 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a645aa25-c372-4cf4-8bf3-1ae231f3f4d6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:35.552075 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a645aa25-c372-4cf4-8bf3-1ae231f3f4d6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1358 microversion: 2.1 time: 0.173619 Nov 02 07:36:35.565605 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 415/830] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:35 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:35.949592 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-62d3b1ca-23b5-498d-b1ea-8cc36a9936d6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:35.950908 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-62d3b1ca-23b5-498d-b1ea-8cc36a9936d6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:35.953168 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:35.961095 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-62d3b1ca-23b5-498d-b1ea-8cc36a9936d6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:35.961964 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-62d3b1ca-23b5-498d-b1ea-8cc36a9936d6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:35.962643 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-62d3b1ca-23b5-498d-b1ea-8cc36a9936d6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:35.963576 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-62d3b1ca-23b5-498d-b1ea-8cc36a9936d6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:35.964239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-62d3b1ca-23b5-498d-b1ea-8cc36a9936d6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:35.967567 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-62d3b1ca-23b5-498d-b1ea-8cc36a9936d6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:36.075048 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-62d3b1ca-23b5-498d-b1ea-8cc36a9936d6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:36.083882 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-62d3b1ca-23b5-498d-b1ea-8cc36a9936d6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1240 microversion: 2.1 time: 0.138579 Nov 02 07:36:36.084475 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 416/831] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:35 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1240 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:36.576371 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-4d29e3ac-3eca-495c-8564-d6bb50f46895 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:36.577075 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-4d29e3ac-3eca-495c-8564-d6bb50f46895 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:36.596508 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d29e3ac-3eca-495c-8564-d6bb50f46895 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:36.596917 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d29e3ac-3eca-495c-8564-d6bb50f46895 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:36.607693 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d29e3ac-3eca-495c-8564-d6bb50f46895 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:36.608886 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d29e3ac-3eca-495c-8564-d6bb50f46895 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:36.611145 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d29e3ac-3eca-495c-8564-d6bb50f46895 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:36.611828 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d29e3ac-3eca-495c-8564-d6bb50f46895 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:36.964073 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-4d29e3ac-3eca-495c-8564-d6bb50f46895 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:36.977465 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-4d29e3ac-3eca-495c-8564-d6bb50f46895 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1358 microversion: 2.1 time: 0.404211 Nov 02 07:36:36.979194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 416/832] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:36 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1358 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:37.109390 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6e56dce4-b2ac-4f93-9605-8f7a094fe12e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:37.111569 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-6e56dce4-b2ac-4f93-9605-8f7a094fe12e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:37.129669 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6e56dce4-b2ac-4f93-9605-8f7a094fe12e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:37.132726 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6e56dce4-b2ac-4f93-9605-8f7a094fe12e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:37.135046 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6e56dce4-b2ac-4f93-9605-8f7a094fe12e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:37.138734 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6e56dce4-b2ac-4f93-9605-8f7a094fe12e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:37.139414 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6e56dce4-b2ac-4f93-9605-8f7a094fe12e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:37.140033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6e56dce4-b2ac-4f93-9605-8f7a094fe12e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:37.273779 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-6e56dce4-b2ac-4f93-9605-8f7a094fe12e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:37.284039 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-6e56dce4-b2ac-4f93-9605-8f7a094fe12e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1240 microversion: 2.1 time: 0.178182 Nov 02 07:36:37.285413 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 417/833] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:37 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1240 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:38.005696 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c4755257-5969-4b13-bd13-f8f8ae582a1a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:38.006565 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c4755257-5969-4b13-bd13-f8f8ae582a1a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:38.013333 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c4755257-5969-4b13-bd13-f8f8ae582a1a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:38.013817 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c4755257-5969-4b13-bd13-f8f8ae582a1a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:38.014255 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c4755257-5969-4b13-bd13-f8f8ae582a1a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:38.014974 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c4755257-5969-4b13-bd13-f8f8ae582a1a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:38.015428 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c4755257-5969-4b13-bd13-f8f8ae582a1a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:38.015853 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c4755257-5969-4b13-bd13-f8f8ae582a1a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:38.164850 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c4755257-5969-4b13-bd13-f8f8ae582a1a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:38.174589 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c4755257-5969-4b13-bd13-f8f8ae582a1a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1358 microversion: 2.1 time: 0.172688 Nov 02 07:36:38.175163 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 417/834] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:38 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:38.307779 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-aa425275-1c23-4499-afb7-748ccc3ce4f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:38.308392 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-aa425275-1c23-4499-afb7-748ccc3ce4f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:38.315583 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa425275-1c23-4499-afb7-748ccc3ce4f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:38.316338 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa425275-1c23-4499-afb7-748ccc3ce4f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:38.316949 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa425275-1c23-4499-afb7-748ccc3ce4f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:38.317655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa425275-1c23-4499-afb7-748ccc3ce4f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:38.318112 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa425275-1c23-4499-afb7-748ccc3ce4f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:38.318556 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-aa425275-1c23-4499-afb7-748ccc3ce4f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:38.384494 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-aa425275-1c23-4499-afb7-748ccc3ce4f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:38.394911 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-aa425275-1c23-4499-afb7-748ccc3ce4f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1240 microversion: 2.1 time: 0.091256 Nov 02 07:36:38.395489 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 418/835] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:38 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:39.197068 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c0437dfd-ddca-4510-afb1-26da12f32197 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:39.198295 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c0437dfd-ddca-4510-afb1-26da12f32197 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:39.207484 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c0437dfd-ddca-4510-afb1-26da12f32197 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:39.208488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c0437dfd-ddca-4510-afb1-26da12f32197 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:39.209133 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c0437dfd-ddca-4510-afb1-26da12f32197 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:39.209832 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c0437dfd-ddca-4510-afb1-26da12f32197 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:39.210314 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c0437dfd-ddca-4510-afb1-26da12f32197 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:39.210991 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c0437dfd-ddca-4510-afb1-26da12f32197 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:39.351047 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c0437dfd-ddca-4510-afb1-26da12f32197 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:39.359679 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c0437dfd-ddca-4510-afb1-26da12f32197 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1358 microversion: 2.1 time: 0.166555 Nov 02 07:36:39.360809 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 418/836] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:39 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:39.417144 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f3b11c81-c65d-4821-8e55-0291501cc986 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:39.417810 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f3b11c81-c65d-4821-8e55-0291501cc986 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:39.424564 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f3b11c81-c65d-4821-8e55-0291501cc986 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:39.424981 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f3b11c81-c65d-4821-8e55-0291501cc986 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:39.425414 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f3b11c81-c65d-4821-8e55-0291501cc986 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:39.426113 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f3b11c81-c65d-4821-8e55-0291501cc986 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:39.426603 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f3b11c81-c65d-4821-8e55-0291501cc986 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:39.427031 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f3b11c81-c65d-4821-8e55-0291501cc986 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:39.447815 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:39.524704 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f3b11c81-c65d-4821-8e55-0291501cc986 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:39.533055 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f3b11c81-c65d-4821-8e55-0291501cc986 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1288 microversion: 2.1 time: 0.118959 Nov 02 07:36:39.533505 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 419/837] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:39 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1288 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:40.383738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-3dff9de9-da36-4bfb-a08b-1334676e3e93 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:40.384502 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-3dff9de9-da36-4bfb-a08b-1334676e3e93 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:40.390532 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3dff9de9-da36-4bfb-a08b-1334676e3e93 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:40.391005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3dff9de9-da36-4bfb-a08b-1334676e3e93 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:40.392176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3dff9de9-da36-4bfb-a08b-1334676e3e93 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:40.392898 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3dff9de9-da36-4bfb-a08b-1334676e3e93 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:40.393616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3dff9de9-da36-4bfb-a08b-1334676e3e93 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:40.393851 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3dff9de9-da36-4bfb-a08b-1334676e3e93 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:40.556394 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ae0674af-a90d-49e7-9464-dc5e7c9d3807 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:40.557005 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ae0674af-a90d-49e7-9464-dc5e7c9d3807 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:40.564563 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ae0674af-a90d-49e7-9464-dc5e7c9d3807 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:40.565123 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ae0674af-a90d-49e7-9464-dc5e7c9d3807 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:40.565621 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ae0674af-a90d-49e7-9464-dc5e7c9d3807 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:40.566297 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ae0674af-a90d-49e7-9464-dc5e7c9d3807 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:40.566836 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ae0674af-a90d-49e7-9464-dc5e7c9d3807 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:40.567255 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ae0674af-a90d-49e7-9464-dc5e7c9d3807 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:40.589507 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-3dff9de9-da36-4bfb-a08b-1334676e3e93 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:40.600900 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-3dff9de9-da36-4bfb-a08b-1334676e3e93 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1358 microversion: 2.1 time: 0.221609 Nov 02 07:36:40.602406 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 419/838] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:40 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:40.647585 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ae0674af-a90d-49e7-9464-dc5e7c9d3807 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:40.660712 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ae0674af-a90d-49e7-9464-dc5e7c9d3807 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1294 microversion: 2.1 time: 0.107275 Nov 02 07:36:40.661715 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 420/839] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:40 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1294 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:36:41.624834 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-025bfeba-8fa6-4561-b8fa-a458964e51d5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:41.625393 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-025bfeba-8fa6-4561-b8fa-a458964e51d5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:41.632778 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-025bfeba-8fa6-4561-b8fa-a458964e51d5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:41.633161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-025bfeba-8fa6-4561-b8fa-a458964e51d5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:41.633708 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-025bfeba-8fa6-4561-b8fa-a458964e51d5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:41.634741 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-025bfeba-8fa6-4561-b8fa-a458964e51d5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:41.635292 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-025bfeba-8fa6-4561-b8fa-a458964e51d5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:41.635711 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-025bfeba-8fa6-4561-b8fa-a458964e51d5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:41.684069 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-4d93d75f-fba3-46d8-be6f-1f9619f61c70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:41.684696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-4d93d75f-fba3-46d8-be6f-1f9619f61c70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:41.691886 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4d93d75f-fba3-46d8-be6f-1f9619f61c70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:41.692379 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4d93d75f-fba3-46d8-be6f-1f9619f61c70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:41.692826 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4d93d75f-fba3-46d8-be6f-1f9619f61c70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:41.693530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4d93d75f-fba3-46d8-be6f-1f9619f61c70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:41.694171 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4d93d75f-fba3-46d8-be6f-1f9619f61c70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:41.694641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4d93d75f-fba3-46d8-be6f-1f9619f61c70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:42.258005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-025bfeba-8fa6-4561-b8fa-a458964e51d5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:42.270145 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-025bfeba-8fa6-4561-b8fa-a458964e51d5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1358 microversion: 2.1 time: 0.649009 Nov 02 07:36:42.271607 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 420/840] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:41 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1358 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:42.281881 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-4d93d75f-fba3-46d8-be6f-1f9619f61c70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:42.285945 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-4d93d75f-fba3-46d8-be6f-1f9619f61c70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1361 microversion: 2.1 time: 0.605888 Nov 02 07:36:42.295479 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 421/841] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:41 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1361 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:36:42.428851 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-65f3a2e6-7a0a-49de-b6a4-341bc21364b7 req-69bcd39c-52a3-4eee-ad22-a15c0bb493dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954fa08b-6370-4f1b-955f-d3c2efe8ba34", "tag": "166f7253-1dcb-4eb0-b3b0-f74792201a1f"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:42.440376 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-65f3a2e6-7a0a-49de-b6a4-341bc21364b7 req-69bcd39c-52a3-4eee-ad22-a15c0bb493dc service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:42.440908 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-65f3a2e6-7a0a-49de-b6a4-341bc21364b7 req-69bcd39c-52a3-4eee-ad22-a15c0bb493dc service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:42.441339 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-65f3a2e6-7a0a-49de-b6a4-341bc21364b7 req-69bcd39c-52a3-4eee-ad22-a15c0bb493dc service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:42.454697 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-65f3a2e6-7a0a-49de-b6a4-341bc21364b7 req-69bcd39c-52a3-4eee-ad22-a15c0bb493dc service nova] Creating event network-changed:166f7253-1dcb-4eb0-b3b0-f74792201a1f for instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 on hv-cinder-80473 Nov 02 07:36:42.460064 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-65f3a2e6-7a0a-49de-b6a4-341bc21364b7 req-69bcd39c-52a3-4eee-ad22-a15c0bb493dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035517 Nov 02 07:36:42.460541 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 421/842] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:36:43.294786 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a5d35919-b9bf-45d7-8115-0a789afb6149 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:43.295394 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a5d35919-b9bf-45d7-8115-0a789afb6149 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:43.301865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a5d35919-b9bf-45d7-8115-0a789afb6149 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:43.302344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a5d35919-b9bf-45d7-8115-0a789afb6149 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:43.302799 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a5d35919-b9bf-45d7-8115-0a789afb6149 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:43.303488 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a5d35919-b9bf-45d7-8115-0a789afb6149 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:43.304215 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a5d35919-b9bf-45d7-8115-0a789afb6149 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:43.304641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a5d35919-b9bf-45d7-8115-0a789afb6149 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:43.309832 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b8b2e0b8-e561-47f1-ad79-d6b34ecea0d1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:43.310569 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b8b2e0b8-e561-47f1-ad79-d6b34ecea0d1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:43.317496 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b8b2e0b8-e561-47f1-ad79-d6b34ecea0d1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:43.317982 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b8b2e0b8-e561-47f1-ad79-d6b34ecea0d1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:43.318588 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b8b2e0b8-e561-47f1-ad79-d6b34ecea0d1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:43.319304 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b8b2e0b8-e561-47f1-ad79-d6b34ecea0d1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:43.319754 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b8b2e0b8-e561-47f1-ad79-d6b34ecea0d1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:43.320240 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b8b2e0b8-e561-47f1-ad79-d6b34ecea0d1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:43.522966 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b8b2e0b8-e561-47f1-ad79-d6b34ecea0d1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:43.523388 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a5d35919-b9bf-45d7-8115-0a789afb6149 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:43.533752 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b8b2e0b8-e561-47f1-ad79-d6b34ecea0d1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1361 microversion: 2.1 time: 0.228179 Nov 02 07:36:43.534581 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 422/843] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:43 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:36:43.535870 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a5d35919-b9bf-45d7-8115-0a789afb6149 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1358 microversion: 2.1 time: 0.244692 Nov 02 07:36:43.536769 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 422/844] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:43 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:36:44.556930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-40b028d9-bd53-4ed4-b3ba-80f5aaf16887 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:44.557542 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-40b028d9-bd53-4ed4-b3ba-80f5aaf16887 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:44.558757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6b3c8b2b-dc89-4e46-a8e6-155ef073ea8b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:44.559378 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-6b3c8b2b-dc89-4e46-a8e6-155ef073ea8b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:44.559533 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:44.560201 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=16 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:44.561341 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=8 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:44.567203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-40b028d9-bd53-4ed4-b3ba-80f5aaf16887 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:44.567586 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6b3c8b2b-dc89-4e46-a8e6-155ef073ea8b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:44.567709 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-40b028d9-bd53-4ed4-b3ba-80f5aaf16887 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:44.568076 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6b3c8b2b-dc89-4e46-a8e6-155ef073ea8b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:44.568235 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-40b028d9-bd53-4ed4-b3ba-80f5aaf16887 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:44.568512 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6b3c8b2b-dc89-4e46-a8e6-155ef073ea8b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:44.568791 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-40b028d9-bd53-4ed4-b3ba-80f5aaf16887 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:44.569207 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6b3c8b2b-dc89-4e46-a8e6-155ef073ea8b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:44.569304 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-40b028d9-bd53-4ed4-b3ba-80f5aaf16887 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:44.569644 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-40b028d9-bd53-4ed4-b3ba-80f5aaf16887 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:44.569742 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6b3c8b2b-dc89-4e46-a8e6-155ef073ea8b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:44.570080 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6b3c8b2b-dc89-4e46-a8e6-155ef073ea8b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:44.773010 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-6b3c8b2b-dc89-4e46-a8e6-155ef073ea8b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:44.776078 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-40b028d9-bd53-4ed4-b3ba-80f5aaf16887 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:44.780671 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-6b3c8b2b-dc89-4e46-a8e6-155ef073ea8b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1358 microversion: 2.1 time: 0.225655 Nov 02 07:36:44.781441 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 423/845] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:44 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:36:44.784312 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-40b028d9-bd53-4ed4-b3ba-80f5aaf16887 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1361 microversion: 2.1 time: 0.231336 Nov 02 07:36:44.784866 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 423/846] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:44 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:45.804716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-70315fa0-6f4c-4c4b-a9ff-7af05533edf3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:45.805328 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-70315fa0-6f4c-4c4b-a9ff-7af05533edf3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:45.806225 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-972690d4-71d1-4982-b540-0026661c50f0 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:45.806870 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-972690d4-71d1-4982-b540-0026661c50f0 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:45.811954 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-70315fa0-6f4c-4c4b-a9ff-7af05533edf3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:45.812672 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-70315fa0-6f4c-4c4b-a9ff-7af05533edf3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:45.813614 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-70315fa0-6f4c-4c4b-a9ff-7af05533edf3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:45.814377 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-972690d4-71d1-4982-b540-0026661c50f0 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:45.814504 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-70315fa0-6f4c-4c4b-a9ff-7af05533edf3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:45.814671 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-972690d4-71d1-4982-b540-0026661c50f0 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:45.814795 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-70315fa0-6f4c-4c4b-a9ff-7af05533edf3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:45.815096 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-972690d4-71d1-4982-b540-0026661c50f0 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:45.815198 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-70315fa0-6f4c-4c4b-a9ff-7af05533edf3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:45.815787 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-972690d4-71d1-4982-b540-0026661c50f0 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:45.816235 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-972690d4-71d1-4982-b540-0026661c50f0 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:45.816689 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-972690d4-71d1-4982-b540-0026661c50f0 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:45.958390 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-972690d4-71d1-4982-b540-0026661c50f0 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:45.966118 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-972690d4-71d1-4982-b540-0026661c50f0 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1361 microversion: 2.1 time: 0.163556 Nov 02 07:36:45.966725 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 424/847] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:45 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:36:46.094174 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-70315fa0-6f4c-4c4b-a9ff-7af05533edf3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:46.101931 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-70315fa0-6f4c-4c4b-a9ff-7af05533edf3 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1358 microversion: 2.1 time: 0.301710 Nov 02 07:36:46.102519 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 424/848] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:45 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:46.884672 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-7eaa291e-bd71-4230-bbdf-11df1f46ab2a req-f7d5617c-498f-4e8f-998d-dfbe1c71b24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8", "name": "network-vif-plugged", "status": "completed", "tag": "33ad81f7-86a8-4d84-8799-f57ab596e5c4"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:46.896677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-7eaa291e-bd71-4230-bbdf-11df1f46ab2a req-f7d5617c-498f-4e8f-998d-dfbe1c71b24f service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:46.897486 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-7eaa291e-bd71-4230-bbdf-11df1f46ab2a req-f7d5617c-498f-4e8f-998d-dfbe1c71b24f service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:46.898624 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-7eaa291e-bd71-4230-bbdf-11df1f46ab2a req-f7d5617c-498f-4e8f-998d-dfbe1c71b24f service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:46.912793 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-7eaa291e-bd71-4230-bbdf-11df1f46ab2a req-f7d5617c-498f-4e8f-998d-dfbe1c71b24f service nova] Creating event network-vif-plugged:33ad81f7-86a8-4d84-8799-f57ab596e5c4 for instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 on hv-cinder-80473 Nov 02 07:36:46.918078 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-7eaa291e-bd71-4230-bbdf-11df1f46ab2a req-f7d5617c-498f-4e8f-998d-dfbe1c71b24f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037827 Nov 02 07:36:46.919631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 425/849] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:36:46.988796 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-945896ed-baf0-471f-889b-3c92f6a0c929 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:46.990171 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-945896ed-baf0-471f-889b-3c92f6a0c929 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:46.996913 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-945896ed-baf0-471f-889b-3c92f6a0c929 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:46.997422 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-945896ed-baf0-471f-889b-3c92f6a0c929 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:46.998091 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-945896ed-baf0-471f-889b-3c92f6a0c929 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:46.998596 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-945896ed-baf0-471f-889b-3c92f6a0c929 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:46.999177 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-945896ed-baf0-471f-889b-3c92f6a0c929 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:46.999483 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-945896ed-baf0-471f-889b-3c92f6a0c929 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:47.125419 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-3325dae3-4175-4abf-9f0c-43b8f89d5c44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:47.126872 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-3325dae3-4175-4abf-9f0c-43b8f89d5c44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:47.133794 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3325dae3-4175-4abf-9f0c-43b8f89d5c44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:47.134498 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3325dae3-4175-4abf-9f0c-43b8f89d5c44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:47.134930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3325dae3-4175-4abf-9f0c-43b8f89d5c44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:47.136012 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3325dae3-4175-4abf-9f0c-43b8f89d5c44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:47.136460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3325dae3-4175-4abf-9f0c-43b8f89d5c44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:47.136884 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3325dae3-4175-4abf-9f0c-43b8f89d5c44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:47.299494 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-945896ed-baf0-471f-889b-3c92f6a0c929 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:47.307303 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-945896ed-baf0-471f-889b-3c92f6a0c929 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1361 microversion: 2.1 time: 0.322318 Nov 02 07:36:47.307873 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 425/850] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:46 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1361 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:36:47.407523 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-3325dae3-4175-4abf-9f0c-43b8f89d5c44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:47.415309 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-3325dae3-4175-4abf-9f0c-43b8f89d5c44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1358 microversion: 2.1 time: 0.294102 Nov 02 07:36:47.415866 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 426/851] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:47 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:36:48.330274 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-5d9920d1-8635-424e-b3a1-40134d75937c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:48.330908 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-5d9920d1-8635-424e-b3a1-40134d75937c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:48.337540 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5d9920d1-8635-424e-b3a1-40134d75937c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:48.338025 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5d9920d1-8635-424e-b3a1-40134d75937c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:48.338508 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5d9920d1-8635-424e-b3a1-40134d75937c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:48.339201 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5d9920d1-8635-424e-b3a1-40134d75937c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:48.339652 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5d9920d1-8635-424e-b3a1-40134d75937c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:48.340075 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5d9920d1-8635-424e-b3a1-40134d75937c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:48.437950 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b680a0a9-135d-4381-8863-e44dd17d2f2d tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:48.439275 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b680a0a9-135d-4381-8863-e44dd17d2f2d tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:48.445655 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b680a0a9-135d-4381-8863-e44dd17d2f2d tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:48.446139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b680a0a9-135d-4381-8863-e44dd17d2f2d tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:48.446601 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b680a0a9-135d-4381-8863-e44dd17d2f2d tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:48.447292 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b680a0a9-135d-4381-8863-e44dd17d2f2d tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:48.447756 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b680a0a9-135d-4381-8863-e44dd17d2f2d tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:48.448168 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b680a0a9-135d-4381-8863-e44dd17d2f2d tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:48.471252 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-5d9920d1-8635-424e-b3a1-40134d75937c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:48.480197 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-5d9920d1-8635-424e-b3a1-40134d75937c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1361 microversion: 2.1 time: 0.154385 Nov 02 07:36:48.480752 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 426/852] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:48 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:48.582700 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-b680a0a9-135d-4381-8863-e44dd17d2f2d tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:48.590256 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b680a0a9-135d-4381-8863-e44dd17d2f2d tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1358 microversion: 2.1 time: 0.156065 Nov 02 07:36:48.590837 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 427/853] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:48 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:36:49.504009 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-52a5027b-2e2f-4a2d-97a6-c5def223452d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:49.504707 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-52a5027b-2e2f-4a2d-97a6-c5def223452d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:49.511409 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-52a5027b-2e2f-4a2d-97a6-c5def223452d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:49.511988 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-52a5027b-2e2f-4a2d-97a6-c5def223452d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:49.512424 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-52a5027b-2e2f-4a2d-97a6-c5def223452d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:49.513121 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-52a5027b-2e2f-4a2d-97a6-c5def223452d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:49.513574 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-52a5027b-2e2f-4a2d-97a6-c5def223452d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:49.513998 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-52a5027b-2e2f-4a2d-97a6-c5def223452d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:49.614749 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c84a89d1-dd58-4eec-a86c-2d891f265c7a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:49.615653 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c84a89d1-dd58-4eec-a86c-2d891f265c7a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:49.623148 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c84a89d1-dd58-4eec-a86c-2d891f265c7a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:49.623692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c84a89d1-dd58-4eec-a86c-2d891f265c7a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:49.624124 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c84a89d1-dd58-4eec-a86c-2d891f265c7a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:49.625008 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c84a89d1-dd58-4eec-a86c-2d891f265c7a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:49.625520 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c84a89d1-dd58-4eec-a86c-2d891f265c7a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:49.626558 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c84a89d1-dd58-4eec-a86c-2d891f265c7a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:49.647399 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-52a5027b-2e2f-4a2d-97a6-c5def223452d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:49.656388 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-52a5027b-2e2f-4a2d-97a6-c5def223452d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1361 microversion: 2.1 time: 0.156934 Nov 02 07:36:49.656950 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 427/854] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:49 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:49.764913 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c84a89d1-dd58-4eec-a86c-2d891f265c7a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:49.772970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c84a89d1-dd58-4eec-a86c-2d891f265c7a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1548 microversion: 2.1 time: 0.163719 Nov 02 07:36:49.773504 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 428/855] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:49 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:36:49.795597 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9bb28a94-d47e-4be2-921e-af76eb2a7041 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:49.796207 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9bb28a94-d47e-4be2-921e-af76eb2a7041 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:49.802960 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9bb28a94-d47e-4be2-921e-af76eb2a7041 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:49.803444 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9bb28a94-d47e-4be2-921e-af76eb2a7041 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:49.803881 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9bb28a94-d47e-4be2-921e-af76eb2a7041 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:49.804576 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9bb28a94-d47e-4be2-921e-af76eb2a7041 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:49.805028 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9bb28a94-d47e-4be2-921e-af76eb2a7041 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:49.805451 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9bb28a94-d47e-4be2-921e-af76eb2a7041 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:49.938469 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9bb28a94-d47e-4be2-921e-af76eb2a7041 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:49.946174 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9bb28a94-d47e-4be2-921e-af76eb2a7041 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1548 microversion: 2.1 time: 0.154380 Nov 02 07:36:49.946749 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 428/856] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:49 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:49.968983 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0d4b7730-6f34-4e18-b64d-438d3ea367f5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:49.974468 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-0d4b7730-6f34-4e18-b64d-438d3ea367f5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:49.975234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-0d4b7730-6f34-4e18-b64d-438d3ea367f5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Searching by: {'deleted': False, 'project_id': '280ce4c6b9174073902820e2e922bedf'} {{(pid=118991) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 07:36:49.981827 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0d4b7730-6f34-4e18-b64d-438d3ea367f5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:49.982298 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0d4b7730-6f34-4e18-b64d-438d3ea367f5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:49.982765 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0d4b7730-6f34-4e18-b64d-438d3ea367f5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:49.983481 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0d4b7730-6f34-4e18-b64d-438d3ea367f5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:49.983929 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0d4b7730-6f34-4e18-b64d-438d3ea367f5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:49.984347 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0d4b7730-6f34-4e18-b64d-438d3ea367f5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:50.056139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=100 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:50.076070 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.multi_cell_list [None req-0d4b7730-6f34-4e18-b64d-438d3ea367f5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118991) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 07:36:50.170806 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0d4b7730-6f34-4e18-b64d-438d3ea367f5 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.205461 Nov 02 07:36:50.171385 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 429/857] 10.222.0.18 () {58 vars in 1125 bytes} [Wed Nov 2 07:36:49 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:36:50.183049 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9be801fa-d90e-4348-b348-8b6d47a57bee tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:50.183657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9be801fa-d90e-4348-b348-8b6d47a57bee tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:50.189460 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9be801fa-d90e-4348-b348-8b6d47a57bee tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:50.189930 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9be801fa-d90e-4348-b348-8b6d47a57bee tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:50.190379 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9be801fa-d90e-4348-b348-8b6d47a57bee tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:50.191054 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9be801fa-d90e-4348-b348-8b6d47a57bee tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:50.191499 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9be801fa-d90e-4348-b348-8b6d47a57bee tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:50.191913 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9be801fa-d90e-4348-b348-8b6d47a57bee tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:50.317946 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9be801fa-d90e-4348-b348-8b6d47a57bee tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:50.325469 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9be801fa-d90e-4348-b348-8b6d47a57bee tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1548 microversion: 2.1 time: 0.146208 Nov 02 07:36:50.326016 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 429/858] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:50 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:50.690062 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-36d241ad-29c0-45df-a5a9-43ec7fbcf8c7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:50.690865 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-36d241ad-29c0-45df-a5a9-43ec7fbcf8c7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:50.703017 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-36d241ad-29c0-45df-a5a9-43ec7fbcf8c7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:50.705568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-36d241ad-29c0-45df-a5a9-43ec7fbcf8c7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:50.708127 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-36d241ad-29c0-45df-a5a9-43ec7fbcf8c7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:50.709688 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-36d241ad-29c0-45df-a5a9-43ec7fbcf8c7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:50.710441 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-36d241ad-29c0-45df-a5a9-43ec7fbcf8c7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:50.711247 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-36d241ad-29c0-45df-a5a9-43ec7fbcf8c7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:50.863847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-36d241ad-29c0-45df-a5a9-43ec7fbcf8c7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:50.872863 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-36d241ad-29c0-45df-a5a9-43ec7fbcf8c7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1361 microversion: 2.1 time: 0.188469 Nov 02 07:36:50.886389 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 430/859] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:50 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:50.905397 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-c7e33c40-1a18-40fc-97ed-429707ca31bc req-fb200505-9fe8-4ca4-baff-6caf3c53bec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954fa08b-6370-4f1b-955f-d3c2efe8ba34", "name": "network-vif-plugged", "status": "completed", "tag": "166f7253-1dcb-4eb0-b3b0-f74792201a1f"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:50.919402 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c7e33c40-1a18-40fc-97ed-429707ca31bc req-fb200505-9fe8-4ca4-baff-6caf3c53bec1 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:50.920333 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c7e33c40-1a18-40fc-97ed-429707ca31bc req-fb200505-9fe8-4ca4-baff-6caf3c53bec1 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:50.920800 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c7e33c40-1a18-40fc-97ed-429707ca31bc req-fb200505-9fe8-4ca4-baff-6caf3c53bec1 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:50.935345 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-c7e33c40-1a18-40fc-97ed-429707ca31bc req-fb200505-9fe8-4ca4-baff-6caf3c53bec1 service nova] Creating event network-vif-plugged:166f7253-1dcb-4eb0-b3b0-f74792201a1f for instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 on hv-cinder-80473 Nov 02 07:36:50.943482 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-c7e33c40-1a18-40fc-97ed-429707ca31bc req-fb200505-9fe8-4ca4-baff-6caf3c53bec1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039410 Nov 02 07:36:50.944679 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 430/860] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:36:51.897579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8f6c8a5d-5716-4078-9a13-1e56a8410dca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:51.898520 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8f6c8a5d-5716-4078-9a13-1e56a8410dca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:51.905712 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8f6c8a5d-5716-4078-9a13-1e56a8410dca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:51.906194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8f6c8a5d-5716-4078-9a13-1e56a8410dca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:51.906853 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8f6c8a5d-5716-4078-9a13-1e56a8410dca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:51.907583 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8f6c8a5d-5716-4078-9a13-1e56a8410dca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:51.908147 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8f6c8a5d-5716-4078-9a13-1e56a8410dca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:51.908575 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8f6c8a5d-5716-4078-9a13-1e56a8410dca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:51.939522 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-54e752a3-c9f1-47b5-bcd8-292d82ce002b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef3d7e3c-3b7c-4993-8504-ceab7baca67f"}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:51.942145 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-54e752a3-c9f1-47b5-bcd8-292d82ce002b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:51.948678 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-54e752a3-c9f1-47b5-bcd8-292d82ce002b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:51.949335 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-54e752a3-c9f1-47b5-bcd8-292d82ce002b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:51.949600 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-54e752a3-c9f1-47b5-bcd8-292d82ce002b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:51.950302 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-54e752a3-c9f1-47b5-bcd8-292d82ce002b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:51.950788 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-54e752a3-c9f1-47b5-bcd8-292d82ce002b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:51.951319 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-54e752a3-c9f1-47b5-bcd8-292d82ce002b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:52.088270 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8f6c8a5d-5716-4078-9a13-1e56a8410dca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:52.096918 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8f6c8a5d-5716-4078-9a13-1e56a8410dca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1361 microversion: 2.1 time: 0.204023 Nov 02 07:36:52.097497 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 431/861] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:51 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:52.254861 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-54e752a3-c9f1-47b5-bcd8-292d82ce002b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "POST /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321286 Nov 02 07:36:52.255479 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 431/862] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 07:36:51 2022] POST /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:36:53.120757 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2ee7ed6c-1cfc-4960-84ce-0d611d146d7e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:53.121398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2ee7ed6c-1cfc-4960-84ce-0d611d146d7e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:53.128335 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2ee7ed6c-1cfc-4960-84ce-0d611d146d7e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:53.128810 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2ee7ed6c-1cfc-4960-84ce-0d611d146d7e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:53.129239 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2ee7ed6c-1cfc-4960-84ce-0d611d146d7e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:53.129923 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2ee7ed6c-1cfc-4960-84ce-0d611d146d7e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:53.130391 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2ee7ed6c-1cfc-4960-84ce-0d611d146d7e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:53.130819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2ee7ed6c-1cfc-4960-84ce-0d611d146d7e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:53.269235 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2ee7ed6c-1cfc-4960-84ce-0d611d146d7e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:53.277151 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2ee7ed6c-1cfc-4960-84ce-0d611d146d7e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1547 microversion: 2.1 time: 0.160087 Nov 02 07:36:53.277844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 432/863] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:53 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:53.302550 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-b771f95a-8c9d-4961-bafc-693083894ca5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:53.303134 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-b771f95a-8c9d-4961-bafc-693083894ca5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:53.309718 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b771f95a-8c9d-4961-bafc-693083894ca5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:53.310204 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b771f95a-8c9d-4961-bafc-693083894ca5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:53.310667 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b771f95a-8c9d-4961-bafc-693083894ca5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:53.311364 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b771f95a-8c9d-4961-bafc-693083894ca5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:53.311818 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b771f95a-8c9d-4961-bafc-693083894ca5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:53.312244 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b771f95a-8c9d-4961-bafc-693083894ca5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:53.400634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-b771f95a-8c9d-4961-bafc-693083894ca5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103041 Nov 02 07:36:53.401213 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 432/864] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 07:36:53 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:36:54.459816 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-c4dccbc5-735f-47a2-be6d-5502b29f1c1a req-c001f7f9-3d03-4cf3-8cba-b91c44023c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954fa08b-6370-4f1b-955f-d3c2efe8ba34", "tag": "166f7253-1dcb-4eb0-b3b0-f74792201a1f"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:54.470487 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-c4dccbc5-735f-47a2-be6d-5502b29f1c1a req-c001f7f9-3d03-4cf3-8cba-b91c44023c1a service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:54.470968 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-c4dccbc5-735f-47a2-be6d-5502b29f1c1a req-c001f7f9-3d03-4cf3-8cba-b91c44023c1a service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:54.471394 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-c4dccbc5-735f-47a2-be6d-5502b29f1c1a req-c001f7f9-3d03-4cf3-8cba-b91c44023c1a service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:54.482738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-c4dccbc5-735f-47a2-be6d-5502b29f1c1a req-c001f7f9-3d03-4cf3-8cba-b91c44023c1a service nova] Creating event network-changed:166f7253-1dcb-4eb0-b3b0-f74792201a1f for instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 on hv-cinder-80473 Nov 02 07:36:54.488202 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-c4dccbc5-735f-47a2-be6d-5502b29f1c1a req-c001f7f9-3d03-4cf3-8cba-b91c44023c1a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032215 Nov 02 07:36:54.488886 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 433/865] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:36:56.784988 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-6abde945-865a-4e63-875d-f1bbe2823141 req-99d584d6-81eb-4bd8-a16e-850128e22571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ad3728-5dee-49b1-a62d-3bdfca6b47ce", "tag": "697a5305-479b-4888-ac9b-d59e4662ea13"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:36:56.787859 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9010b46a-3114-48cc-ba2f-7807910bed24 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:56.788966 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9010b46a-3114-48cc-ba2f-7807910bed24 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:56.801000 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9010b46a-3114-48cc-ba2f-7807910bed24 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:56.802556 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9010b46a-3114-48cc-ba2f-7807910bed24 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:56.803732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9010b46a-3114-48cc-ba2f-7807910bed24 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:56.804671 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9010b46a-3114-48cc-ba2f-7807910bed24 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:56.804800 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-6abde945-865a-4e63-875d-f1bbe2823141 req-99d584d6-81eb-4bd8-a16e-850128e22571 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:56.805242 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-6abde945-865a-4e63-875d-f1bbe2823141 req-99d584d6-81eb-4bd8-a16e-850128e22571 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:56.805529 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9010b46a-3114-48cc-ba2f-7807910bed24 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:56.805686 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-6abde945-865a-4e63-875d-f1bbe2823141 req-99d584d6-81eb-4bd8-a16e-850128e22571 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:56.806278 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9010b46a-3114-48cc-ba2f-7807910bed24 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:56.847632 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-6abde945-865a-4e63-875d-f1bbe2823141 req-99d584d6-81eb-4bd8-a16e-850128e22571 service nova] Creating event network-changed:697a5305-479b-4888-ac9b-d59e4662ea13 for instance 22ad3728-5dee-49b1-a62d-3bdfca6b47ce on hv-cinder-80473 Nov 02 07:36:56.855642 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9010b46a-3114-48cc-ba2f-7807910bed24 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Going to try to terminate instance {{(pid=118992) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:36:56.859103 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-6abde945-865a-4e63-875d-f1bbe2823141 req-99d584d6-81eb-4bd8-a16e-850128e22571 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078488 Nov 02 07:36:56.860896 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 434/866] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:36:56.982899 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9010b46a-3114-48cc-ba2f-7807910bed24 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "DELETE /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 204 len: 0 microversion: 2.1 time: 0.206119 Nov 02 07:36:56.983498 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 433/867] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:36:56 2022] DELETE /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:36:56.993243 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-9f75cb45-b2d6-4cf7-9cec-f9194dda3878 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:56.993952 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-9f75cb45-b2d6-4cf7-9cec-f9194dda3878 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:57.000401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9f75cb45-b2d6-4cf7-9cec-f9194dda3878 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:57.001038 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9f75cb45-b2d6-4cf7-9cec-f9194dda3878 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:57.001286 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9f75cb45-b2d6-4cf7-9cec-f9194dda3878 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:57.001985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9f75cb45-b2d6-4cf7-9cec-f9194dda3878 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:57.002471 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9f75cb45-b2d6-4cf7-9cec-f9194dda3878 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:57.002893 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9f75cb45-b2d6-4cf7-9cec-f9194dda3878 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:57.141539 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-9f75cb45-b2d6-4cf7-9cec-f9194dda3878 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:57.150269 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-9f75cb45-b2d6-4cf7-9cec-f9194dda3878 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.161342 Nov 02 07:36:57.150880 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 435/868] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:56 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:58.176246 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d9ec62f8-e684-478e-bb77-3dcc48f189d3 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:58.177175 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-d9ec62f8-e684-478e-bb77-3dcc48f189d3 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:58.184004 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d9ec62f8-e684-478e-bb77-3dcc48f189d3 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:58.184564 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d9ec62f8-e684-478e-bb77-3dcc48f189d3 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:58.185059 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d9ec62f8-e684-478e-bb77-3dcc48f189d3 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:58.185840 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d9ec62f8-e684-478e-bb77-3dcc48f189d3 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:58.186550 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d9ec62f8-e684-478e-bb77-3dcc48f189d3 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:58.187108 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d9ec62f8-e684-478e-bb77-3dcc48f189d3 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:58.211942 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:36:58.367166 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-d9ec62f8-e684-478e-bb77-3dcc48f189d3 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:58.375073 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-d9ec62f8-e684-478e-bb77-3dcc48f189d3 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.204098 Nov 02 07:36:58.375631 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 434/869] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:58 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:59.398620 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-225f9877-599b-4c55-9db5-49727c74cac6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:59.399238 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-225f9877-599b-4c55-9db5-49727c74cac6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:59.405581 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-225f9877-599b-4c55-9db5-49727c74cac6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:59.406089 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-225f9877-599b-4c55-9db5-49727c74cac6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:59.406548 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-225f9877-599b-4c55-9db5-49727c74cac6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:59.407771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-225f9877-599b-4c55-9db5-49727c74cac6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:59.408227 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-225f9877-599b-4c55-9db5-49727c74cac6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:59.408648 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-225f9877-599b-4c55-9db5-49727c74cac6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:59.565488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-225f9877-599b-4c55-9db5-49727c74cac6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:36:59.576692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-225f9877-599b-4c55-9db5-49727c74cac6 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1568 microversion: 2.1 time: 0.181775 Nov 02 07:36:59.591495 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 436/870] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:59 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:36:59.927497 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a8f2c8b8-2235-49f0-a379-b2c6f1b1fb21 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:36:59.928142 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a8f2c8b8-2235-49f0-a379-b2c6f1b1fb21 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:36:59.935235 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a8f2c8b8-2235-49f0-a379-b2c6f1b1fb21 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:59.935712 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a8f2c8b8-2235-49f0-a379-b2c6f1b1fb21 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:59.936141 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a8f2c8b8-2235-49f0-a379-b2c6f1b1fb21 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:36:59.936829 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a8f2c8b8-2235-49f0-a379-b2c6f1b1fb21 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:36:59.937277 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a8f2c8b8-2235-49f0-a379-b2c6f1b1fb21 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:36:59.937690 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a8f2c8b8-2235-49f0-a379-b2c6f1b1fb21 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:00.062149 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-55a1d8df-7aa5-4ad3-b2c8-3b2ea560c12e req-5613390f-cc52-482a-a0b3-c8cb1a3aa47d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ad3728-5dee-49b1-a62d-3bdfca6b47ce", "name": "network-vif-deleted", "tag": "697a5305-479b-4888-ac9b-d59e4662ea13"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:37:00.070968 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:00.076020 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-55a1d8df-7aa5-4ad3-b2c8-3b2ea560c12e req-5613390f-cc52-482a-a0b3-c8cb1a3aa47d service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:00.076579 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-55a1d8df-7aa5-4ad3-b2c8-3b2ea560c12e req-5613390f-cc52-482a-a0b3-c8cb1a3aa47d service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:00.077100 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-55a1d8df-7aa5-4ad3-b2c8-3b2ea560c12e req-5613390f-cc52-482a-a0b3-c8cb1a3aa47d service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:00.091361 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-55a1d8df-7aa5-4ad3-b2c8-3b2ea560c12e req-5613390f-cc52-482a-a0b3-c8cb1a3aa47d service nova] Creating event network-vif-deleted:697a5305-479b-4888-ac9b-d59e4662ea13 for instance 22ad3728-5dee-49b1-a62d-3bdfca6b47ce on hv-cinder-80473 Nov 02 07:37:00.096805 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-55a1d8df-7aa5-4ad3-b2c8-3b2ea560c12e req-5613390f-cc52-482a-a0b3-c8cb1a3aa47d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038733 Nov 02 07:37:00.097412 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 437/871] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:37:00.132225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a8f2c8b8-2235-49f0-a379-b2c6f1b1fb21 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:00.144037 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a8f2c8b8-2235-49f0-a379-b2c6f1b1fb21 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1594 microversion: 2.1 time: 0.220968 Nov 02 07:37:00.144613 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 435/872] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:36:59 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1594 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:00.609570 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-74fb645b-05a9-4976-be27-4a1ba7176b15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:00.610444 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-74fb645b-05a9-4976-be27-4a1ba7176b15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:00.618123 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-74fb645b-05a9-4976-be27-4a1ba7176b15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:00.622743 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-74fb645b-05a9-4976-be27-4a1ba7176b15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:00.624800 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-74fb645b-05a9-4976-be27-4a1ba7176b15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:00.627581 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-74fb645b-05a9-4976-be27-4a1ba7176b15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:00.628249 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-74fb645b-05a9-4976-be27-4a1ba7176b15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:00.628868 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-74fb645b-05a9-4976-be27-4a1ba7176b15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:00.674622 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-74fb645b-05a9-4976-be27-4a1ba7176b15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:00.675106 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-74fb645b-05a9-4976-be27-4a1ba7176b15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:00.675539 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-74fb645b-05a9-4976-be27-4a1ba7176b15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:00.675995 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.objects.instance [None req-74fb645b-05a9-4976-be27-4a1ba7176b15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lazy-loading 'fault' on Instance uuid 22ad3728-5dee-49b1-a62d-3bdfca6b47ce {{(pid=118991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:37:00.733277 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-74fb645b-05a9-4976-be27-4a1ba7176b15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040b847b0db549a2a865deb7be6a8da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82915a36bbdb4b5998fd98833e234ad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:00.745705 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-74fb645b-05a9-4976-be27-4a1ba7176b15 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 200 len: 1223 microversion: 2.1 time: 0.144056 Nov 02 07:37:00.747218 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 438/873] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:00 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 1223 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:01.771855 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-69e0c804-fc73-4ef7-a842-3f1347a3d3c7 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:01.772604 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-69e0c804-fc73-4ef7-a842-3f1347a3d3c7 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] [instance: 22ad3728-5dee-49b1-a62d-3bdfca6b47ce] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:01.780446 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-69e0c804-fc73-4ef7-a842-3f1347a3d3c7 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:01.781062 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-69e0c804-fc73-4ef7-a842-3f1347a3d3c7 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:01.781492 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-69e0c804-fc73-4ef7-a842-3f1347a3d3c7 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:01.782795 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-69e0c804-fc73-4ef7-a842-3f1347a3d3c7 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:01.783262 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-69e0c804-fc73-4ef7-a842-3f1347a3d3c7 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:01.783682 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-69e0c804-fc73-4ef7-a842-3f1347a3d3c7 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:01.799436 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-69e0c804-fc73-4ef7-a842-3f1347a3d3c7 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] HTTP exception thrown: Instance 22ad3728-5dee-49b1-a62d-3bdfca6b47ce could not be found. Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-69e0c804-fc73-4ef7-a842-3f1347a3d3c7 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Request method failure captured: Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce HTTP/1.1 Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhzY04gqqq4ZgoGS62wEAKUH2q3iwQUuLud3H-B-doICSMaYVLINMGs8WEpq3aWUlBeuitrjV2l7zAk6Xr8iLmpLPMf2vqP2FuppIl7jaqbsVK86NiNWgtKayiwvrEVArtEXnw9UCy2nnhGmsVRbPYAxL9vorxUCeDnAcztOx74iWlk Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: 82915a36bbdb4b5998fd98833e234ad2 Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-TestShelveInstance-1757240858 Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:37:01.801116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:37:01.802865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82915a36bbdb4b5998fd98833e234ad2", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82915a36bbdb4b5998fd98833e234ad2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82915a36bbdb4b5998fd98833e234ad2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82915a36bbdb4b5998fd98833e234ad2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:37:01.802865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-TestShelveInstance-1757240858 Nov 02 07:37:01.802865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: 82915a36bbdb4b5998fd98833e234ad2 Nov 02 07:37:01.802865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-TestShelveInstance-1757240858 Nov 02 07:37:01.802865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-TestShelveInstance-1757240858-project Nov 02 07:37:01.802865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:37:01.802865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:37:01.802865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 040b847b0db549a2a865deb7be6a8da7 Nov 02 07:37:01.802865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-TestShelveInstance-1757240858-project Nov 02 07:37:01.802865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:37:01.802865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 22ad3728-5dee-49b1-a62d-3bdfca6b47ce could not be found. Nov 02 07:37:01.802865 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '22ad3728-5dee-49b1-a62d-3bdfca6b47ce'} Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ad3728-5dee-49b1-a62d-3bdfca6b47ce could not be found. Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:37:01.803816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ad3728-5dee-49b1-a62d-3bdfca6b47ce could not be found. Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ad3728-5dee-49b1-a62d-3bdfca6b47ce could not be found. Nov 02 07:37:01.806696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:37:01.808020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-69e0c804-fc73-4ef7-a842-3f1347a3d3c7 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Returning 404 to user: Instance 22ad3728-5dee-49b1-a62d-3bdfca6b47ce could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:37:01.808020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-69e0c804-fc73-4ef7-a842-3f1347a3d3c7 tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce" status: 404 len: 111 microversion: 2.1 time: 0.034878 Nov 02 07:37:01.808020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 436/874] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:01 2022] GET /compute/v2.1/servers/22ad3728-5dee-49b1-a62d-3bdfca6b47ce => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:37:01.971680 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-89126f87-221e-440d-a9e2-a3dd8393367d tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] Calling method '.version_select at 0x7f4d6a1d79d0>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:01.993056 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-89126f87-221e-440d-a9e2-a3dd8393367d tempest-TestShelveInstance-1757240858 tempest-TestShelveInstance-1757240858-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-399650938" status: 202 len: 0 microversion: 2.1 time: 0.026030 Nov 02 07:37:01.993793 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 439/875] 10.222.0.18 () {58 vars in 1251 bytes} [Wed Nov 2 07:37:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-399650938 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:37:02.276176 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-536bffb0-944e-494b-bb19-e8369581c16a req-f1b08958-8e6e-424d-b823-297c196aff2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8", "tag": "33ad81f7-86a8-4d84-8799-f57ab596e5c4"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:37:02.287099 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-536bffb0-944e-494b-bb19-e8369581c16a req-f1b08958-8e6e-424d-b823-297c196aff2b service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:02.287841 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-536bffb0-944e-494b-bb19-e8369581c16a req-f1b08958-8e6e-424d-b823-297c196aff2b service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:02.288431 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-536bffb0-944e-494b-bb19-e8369581c16a req-f1b08958-8e6e-424d-b823-297c196aff2b service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:02.305794 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-536bffb0-944e-494b-bb19-e8369581c16a req-f1b08958-8e6e-424d-b823-297c196aff2b service nova] Creating event network-changed:33ad81f7-86a8-4d84-8799-f57ab596e5c4 for instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 on hv-cinder-80473 Nov 02 07:37:02.311097 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-536bffb0-944e-494b-bb19-e8369581c16a req-f1b08958-8e6e-424d-b823-297c196aff2b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039211 Nov 02 07:37:02.311992 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 437/876] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:37:03.505260 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-600b0f45-f4e1-4be8-aca9-14188aa9604b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-223621325"}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:37:03.505928 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-600b0f45-f4e1-4be8-aca9-14188aa9604b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:03.508388 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:03.516139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-600b0f45-f4e1-4be8-aca9-14188aa9604b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:03.517295 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-600b0f45-f4e1-4be8-aca9-14188aa9604b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:03.517822 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-600b0f45-f4e1-4be8-aca9-14188aa9604b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:03.518639 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-600b0f45-f4e1-4be8-aca9-14188aa9604b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:03.519316 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-600b0f45-f4e1-4be8-aca9-14188aa9604b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:03.519954 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-600b0f45-f4e1-4be8-aca9-14188aa9604b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:03.859069 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.network.security_group_api [None req-600b0f45-f4e1-4be8-aca9-14188aa9604b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Adding security group 5955c213-20e0-4cb5-b4d4-acf9e40431f3 to port 33ad81f7-86a8-4d84-8799-f57ab596e5c4 Nov 02 07:37:04.473240 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-600b0f45-f4e1-4be8-aca9-14188aa9604b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "POST /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/action" status: 202 len: 0 microversion: 2.1 time: 0.972425 Nov 02 07:37:04.474212 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 440/877] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 07:37:03 2022] POST /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/action => generated 0 bytes in 974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:37:04.484391 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-33130de3-1f96-40e1-ab96-a46c01eb8782 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:04.485084 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-33130de3-1f96-40e1-ab96-a46c01eb8782 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:04.487857 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:04.494765 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-33130de3-1f96-40e1-ab96-a46c01eb8782 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:04.495465 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-33130de3-1f96-40e1-ab96-a46c01eb8782 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:04.496052 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-33130de3-1f96-40e1-ab96-a46c01eb8782 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:04.496948 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-33130de3-1f96-40e1-ab96-a46c01eb8782 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:04.497773 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-33130de3-1f96-40e1-ab96-a46c01eb8782 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:04.498348 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-33130de3-1f96-40e1-ab96-a46c01eb8782 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:04.612004 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-9ad44e11-322e-4a33-8725-c54057788d5c req-fb00be15-67fd-417c-a892-968393a6da58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8", "tag": "33ad81f7-86a8-4d84-8799-f57ab596e5c4"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:37:04.630668 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-9ad44e11-322e-4a33-8725-c54057788d5c req-fb00be15-67fd-417c-a892-968393a6da58 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:04.631437 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-9ad44e11-322e-4a33-8725-c54057788d5c req-fb00be15-67fd-417c-a892-968393a6da58 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:04.632060 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-9ad44e11-322e-4a33-8725-c54057788d5c req-fb00be15-67fd-417c-a892-968393a6da58 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:04.661589 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-9ad44e11-322e-4a33-8725-c54057788d5c req-fb00be15-67fd-417c-a892-968393a6da58 service nova] Creating event network-changed:33ad81f7-86a8-4d84-8799-f57ab596e5c4 for instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 on hv-cinder-80473 Nov 02 07:37:04.668002 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-9ad44e11-322e-4a33-8725-c54057788d5c req-fb00be15-67fd-417c-a892-968393a6da58 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061151 Nov 02 07:37:04.668825 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 441/878] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:37:04.801165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-33130de3-1f96-40e1-ab96-a46c01eb8782 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:04.817323 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-33130de3-1f96-40e1-ab96-a46c01eb8782 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1759 microversion: 2.1 time: 0.338267 Nov 02 07:37:04.818186 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 438/879] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:04 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1759 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:28.282224 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-445b3333-55e2-4c5b-aeda-ce61e6f3d6c6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:37:28.284531 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-445b3333-55e2-4c5b-aeda-ce61e6f3d6c6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:28.287377 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=3 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:28.288155 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=56 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:28.294159 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-445b3333-55e2-4c5b-aeda-ce61e6f3d6c6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:28.294659 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-445b3333-55e2-4c5b-aeda-ce61e6f3d6c6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:28.295089 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-445b3333-55e2-4c5b-aeda-ce61e6f3d6c6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:28.295770 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-445b3333-55e2-4c5b-aeda-ce61e6f3d6c6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:28.296214 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-445b3333-55e2-4c5b-aeda-ce61e6f3d6c6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:28.296625 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-445b3333-55e2-4c5b-aeda-ce61e6f3d6c6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:28.366844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-445b3333-55e2-4c5b-aeda-ce61e6f3d6c6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "POST /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/action" status: 202 len: 0 microversion: 2.1 time: 0.088634 Nov 02 07:37:28.367471 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 442/880] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 07:37:28 2022] POST /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:37:28.375539 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-325a6940-a1ef-40b4-a69a-093d46d8be10 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:28.376180 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-325a6940-a1ef-40b4-a69a-093d46d8be10 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:28.378743 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=1 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:28.379397 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=20 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:28.385566 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-325a6940-a1ef-40b4-a69a-093d46d8be10 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:28.386040 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-325a6940-a1ef-40b4-a69a-093d46d8be10 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:28.386507 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-325a6940-a1ef-40b4-a69a-093d46d8be10 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:28.387190 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-325a6940-a1ef-40b4-a69a-093d46d8be10 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:28.387641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-325a6940-a1ef-40b4-a69a-093d46d8be10 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:28.388058 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-325a6940-a1ef-40b4-a69a-093d46d8be10 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:28.532990 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-325a6940-a1ef-40b4-a69a-093d46d8be10 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:28.542071 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-325a6940-a1ef-40b4-a69a-093d46d8be10 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1751 microversion: 2.1 time: 0.170450 Nov 02 07:37:28.542661 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 439/881] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:28 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:29.565957 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-7560e782-f6cc-4a85-9e85-0677e6bcb612 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:29.566718 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-7560e782-f6cc-4a85-9e85-0677e6bcb612 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:29.573550 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7560e782-f6cc-4a85-9e85-0677e6bcb612 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:29.574026 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7560e782-f6cc-4a85-9e85-0677e6bcb612 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:29.574489 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7560e782-f6cc-4a85-9e85-0677e6bcb612 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:29.575181 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7560e782-f6cc-4a85-9e85-0677e6bcb612 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:29.575625 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7560e782-f6cc-4a85-9e85-0677e6bcb612 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:29.576072 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7560e782-f6cc-4a85-9e85-0677e6bcb612 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:29.719053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7560e782-f6cc-4a85-9e85-0677e6bcb612 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:29.728596 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-7560e782-f6cc-4a85-9e85-0677e6bcb612 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1751 microversion: 2.1 time: 0.167142 Nov 02 07:37:29.729143 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 443/882] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:29 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:30.752326 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3caa3890-1ef0-4bcf-b1d9-204c8bdc775a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:30.752940 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3caa3890-1ef0-4bcf-b1d9-204c8bdc775a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:30.760158 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3caa3890-1ef0-4bcf-b1d9-204c8bdc775a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:30.760673 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3caa3890-1ef0-4bcf-b1d9-204c8bdc775a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:30.761104 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3caa3890-1ef0-4bcf-b1d9-204c8bdc775a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:30.761790 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3caa3890-1ef0-4bcf-b1d9-204c8bdc775a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:30.762238 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3caa3890-1ef0-4bcf-b1d9-204c8bdc775a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:30.762682 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-3caa3890-1ef0-4bcf-b1d9-204c8bdc775a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:30.973807 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3caa3890-1ef0-4bcf-b1d9-204c8bdc775a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:30.982432 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3caa3890-1ef0-4bcf-b1d9-204c8bdc775a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1751 microversion: 2.1 time: 0.233859 Nov 02 07:37:30.983007 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 440/883] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:30 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1751 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:32.007215 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c2cb3b49-3dab-4657-bf80-05a3340ba047 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:32.007854 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c2cb3b49-3dab-4657-bf80-05a3340ba047 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:32.014045 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c2cb3b49-3dab-4657-bf80-05a3340ba047 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:32.014583 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c2cb3b49-3dab-4657-bf80-05a3340ba047 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:32.015020 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c2cb3b49-3dab-4657-bf80-05a3340ba047 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:32.015711 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c2cb3b49-3dab-4657-bf80-05a3340ba047 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:32.016169 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c2cb3b49-3dab-4657-bf80-05a3340ba047 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:32.016621 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c2cb3b49-3dab-4657-bf80-05a3340ba047 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:32.578070 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c2cb3b49-3dab-4657-bf80-05a3340ba047 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:32.586817 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c2cb3b49-3dab-4657-bf80-05a3340ba047 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.584302 Nov 02 07:37:32.587385 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 444/884] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:32 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:33.610757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-12c4b94a-9af7-4c78-b0be-b1132c040f0f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:33.611389 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-12c4b94a-9af7-4c78-b0be-b1132c040f0f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:33.618686 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-12c4b94a-9af7-4c78-b0be-b1132c040f0f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:33.619165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-12c4b94a-9af7-4c78-b0be-b1132c040f0f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:33.619591 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-12c4b94a-9af7-4c78-b0be-b1132c040f0f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:33.620304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-12c4b94a-9af7-4c78-b0be-b1132c040f0f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:33.620750 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-12c4b94a-9af7-4c78-b0be-b1132c040f0f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:33.621169 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-12c4b94a-9af7-4c78-b0be-b1132c040f0f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:33.774297 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-12c4b94a-9af7-4c78-b0be-b1132c040f0f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:33.782486 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-12c4b94a-9af7-4c78-b0be-b1132c040f0f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.175875 Nov 02 07:37:33.783041 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 441/885] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:33 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:34.806172 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-7ae640f4-5ec1-4923-b338-45ba755597e9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:34.806879 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-7ae640f4-5ec1-4923-b338-45ba755597e9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:34.813286 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7ae640f4-5ec1-4923-b338-45ba755597e9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:34.813762 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7ae640f4-5ec1-4923-b338-45ba755597e9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:34.814192 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7ae640f4-5ec1-4923-b338-45ba755597e9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:34.814903 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7ae640f4-5ec1-4923-b338-45ba755597e9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:34.815358 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7ae640f4-5ec1-4923-b338-45ba755597e9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:34.815778 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-7ae640f4-5ec1-4923-b338-45ba755597e9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:34.954168 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-7ae640f4-5ec1-4923-b338-45ba755597e9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:34.962631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-7ae640f4-5ec1-4923-b338-45ba755597e9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.160856 Nov 02 07:37:34.963192 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 445/886] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:34 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:35.986667 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c627d6de-c003-4861-9434-ac57ff60a364 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:35.987205 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c627d6de-c003-4861-9434-ac57ff60a364 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:35.993739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c627d6de-c003-4861-9434-ac57ff60a364 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:35.994266 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c627d6de-c003-4861-9434-ac57ff60a364 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:35.994737 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c627d6de-c003-4861-9434-ac57ff60a364 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:35.995426 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c627d6de-c003-4861-9434-ac57ff60a364 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:35.995883 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c627d6de-c003-4861-9434-ac57ff60a364 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:35.996304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c627d6de-c003-4861-9434-ac57ff60a364 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:36.139140 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c627d6de-c003-4861-9434-ac57ff60a364 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:36.148080 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c627d6de-c003-4861-9434-ac57ff60a364 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.165432 Nov 02 07:37:36.148647 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 442/887] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:35 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:37.172611 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8634837a-9b97-46e3-abda-992f0cfa9c41 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:37.173421 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8634837a-9b97-46e3-abda-992f0cfa9c41 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:37.180718 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8634837a-9b97-46e3-abda-992f0cfa9c41 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:37.181206 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8634837a-9b97-46e3-abda-992f0cfa9c41 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:37.181635 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8634837a-9b97-46e3-abda-992f0cfa9c41 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:37.182409 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8634837a-9b97-46e3-abda-992f0cfa9c41 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:37.182859 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8634837a-9b97-46e3-abda-992f0cfa9c41 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:37.183305 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8634837a-9b97-46e3-abda-992f0cfa9c41 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:37.330423 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-8634837a-9b97-46e3-abda-992f0cfa9c41 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:37.341987 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8634837a-9b97-46e3-abda-992f0cfa9c41 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.173412 Nov 02 07:37:37.342597 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 446/888] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:37 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:38.176727 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-437a207f-d7e6-4848-affe-2ca526e9f846 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:38.177259 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-437a207f-d7e6-4848-affe-2ca526e9f846 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:38.183813 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-437a207f-d7e6-4848-affe-2ca526e9f846 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:38.184290 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-437a207f-d7e6-4848-affe-2ca526e9f846 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:38.184725 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-437a207f-d7e6-4848-affe-2ca526e9f846 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:38.185408 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-437a207f-d7e6-4848-affe-2ca526e9f846 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:38.185859 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-437a207f-d7e6-4848-affe-2ca526e9f846 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:38.186279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-437a207f-d7e6-4848-affe-2ca526e9f846 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:38.209670 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-437a207f-d7e6-4848-affe-2ca526e9f846 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/ips" status: 200 len: 145 microversion: 2.1 time: 0.036869 Nov 02 07:37:38.210218 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 443/889] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 07:37:38 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:37:38.365450 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-61909531-f05e-4e4f-a991-5f18b87dc81a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:38.366053 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-61909531-f05e-4e4f-a991-5f18b87dc81a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:38.372754 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61909531-f05e-4e4f-a991-5f18b87dc81a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:38.373332 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61909531-f05e-4e4f-a991-5f18b87dc81a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:38.373780 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61909531-f05e-4e4f-a991-5f18b87dc81a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:38.374492 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61909531-f05e-4e4f-a991-5f18b87dc81a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:38.374952 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61909531-f05e-4e4f-a991-5f18b87dc81a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:38.375377 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61909531-f05e-4e4f-a991-5f18b87dc81a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:38.517280 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-61909531-f05e-4e4f-a991-5f18b87dc81a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:38.526442 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-61909531-f05e-4e4f-a991-5f18b87dc81a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.165039 Nov 02 07:37:38.526997 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 447/890] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:38 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:39.550466 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-09f2f391-5553-4c98-afd5-dd4a3f224be2 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:39.551075 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-09f2f391-5553-4c98-afd5-dd4a3f224be2 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:39.566037 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-09f2f391-5553-4c98-afd5-dd4a3f224be2 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:39.571033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-09f2f391-5553-4c98-afd5-dd4a3f224be2 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:39.571541 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-09f2f391-5553-4c98-afd5-dd4a3f224be2 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:39.572560 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-09f2f391-5553-4c98-afd5-dd4a3f224be2 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:39.573027 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-09f2f391-5553-4c98-afd5-dd4a3f224be2 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:39.573452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-09f2f391-5553-4c98-afd5-dd4a3f224be2 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:39.742791 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-09f2f391-5553-4c98-afd5-dd4a3f224be2 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:39.750975 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-09f2f391-5553-4c98-afd5-dd4a3f224be2 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.205035 Nov 02 07:37:39.751536 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 444/891] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:39 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:40.671403 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-b350614c-899a-4c25-b84a-74745fd5ffcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e69b04ea-75b4-48f0-a710-5eb49637f642"}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:37:40.673718 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-b350614c-899a-4c25-b84a-74745fd5ffcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:40.680577 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b350614c-899a-4c25-b84a-74745fd5ffcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:40.681067 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b350614c-899a-4c25-b84a-74745fd5ffcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:40.681508 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b350614c-899a-4c25-b84a-74745fd5ffcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:40.682190 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b350614c-899a-4c25-b84a-74745fd5ffcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:40.682669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b350614c-899a-4c25-b84a-74745fd5ffcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:40.683093 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-b350614c-899a-4c25-b84a-74745fd5ffcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:40.775226 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-db909510-fa23-4abb-b944-73c65aeccd95 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:40.775837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-db909510-fa23-4abb-b944-73c65aeccd95 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:40.782337 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-db909510-fa23-4abb-b944-73c65aeccd95 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:40.782841 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-db909510-fa23-4abb-b944-73c65aeccd95 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:40.783283 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-db909510-fa23-4abb-b944-73c65aeccd95 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:40.783949 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-db909510-fa23-4abb-b944-73c65aeccd95 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:40.784393 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-db909510-fa23-4abb-b944-73c65aeccd95 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:40.785004 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-db909510-fa23-4abb-b944-73c65aeccd95 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:40.937143 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-db909510-fa23-4abb-b944-73c65aeccd95 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:40.952084 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-db909510-fa23-4abb-b944-73c65aeccd95 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.180688 Nov 02 07:37:40.952650 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 445/892] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:40 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:37:40.968624 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-b350614c-899a-4c25-b84a-74745fd5ffcd tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "POST /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300966 Nov 02 07:37:40.969525 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 448/893] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 07:37:40 2022] POST /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:37:41.976555 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-83aa02e7-f58c-46f2-8213-5cc87b89e671 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:41.977350 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-83aa02e7-f58c-46f2-8213-5cc87b89e671 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:41.985572 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83aa02e7-f58c-46f2-8213-5cc87b89e671 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:41.986068 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83aa02e7-f58c-46f2-8213-5cc87b89e671 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:41.986539 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83aa02e7-f58c-46f2-8213-5cc87b89e671 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:41.987241 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83aa02e7-f58c-46f2-8213-5cc87b89e671 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:41.987695 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83aa02e7-f58c-46f2-8213-5cc87b89e671 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:41.988124 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83aa02e7-f58c-46f2-8213-5cc87b89e671 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:42.133531 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-83aa02e7-f58c-46f2-8213-5cc87b89e671 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:42.142044 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-83aa02e7-f58c-46f2-8213-5cc87b89e671 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.170216 Nov 02 07:37:42.142567 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 446/894] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:41 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:43.167170 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-61d90ecb-bf87-4659-9044-b193732b8499 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:43.167948 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-61d90ecb-bf87-4659-9044-b193732b8499 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:43.174729 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61d90ecb-bf87-4659-9044-b193732b8499 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:43.175281 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61d90ecb-bf87-4659-9044-b193732b8499 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:43.175774 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61d90ecb-bf87-4659-9044-b193732b8499 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:43.176526 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61d90ecb-bf87-4659-9044-b193732b8499 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:43.177042 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61d90ecb-bf87-4659-9044-b193732b8499 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:43.177564 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61d90ecb-bf87-4659-9044-b193732b8499 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:43.344619 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-61d90ecb-bf87-4659-9044-b193732b8499 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:43.353700 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-61d90ecb-bf87-4659-9044-b193732b8499 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.190782 Nov 02 07:37:43.354258 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 449/895] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:43 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:44.377606 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6f088dd7-c9de-45cb-8b49-d8600d775e60 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:44.378226 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-6f088dd7-c9de-45cb-8b49-d8600d775e60 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:44.384990 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6f088dd7-c9de-45cb-8b49-d8600d775e60 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:44.385478 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6f088dd7-c9de-45cb-8b49-d8600d775e60 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:44.385914 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6f088dd7-c9de-45cb-8b49-d8600d775e60 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:44.386648 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6f088dd7-c9de-45cb-8b49-d8600d775e60 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:44.387107 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6f088dd7-c9de-45cb-8b49-d8600d775e60 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:44.387539 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6f088dd7-c9de-45cb-8b49-d8600d775e60 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:44.540242 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-6f088dd7-c9de-45cb-8b49-d8600d775e60 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:44.548739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-6f088dd7-c9de-45cb-8b49-d8600d775e60 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.175016 Nov 02 07:37:44.549314 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 447/896] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:44 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:45.576029 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-db5ebc24-1e53-46a8-8681-38cf0907ab5b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:45.576635 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-db5ebc24-1e53-46a8-8681-38cf0907ab5b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:45.583241 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-db5ebc24-1e53-46a8-8681-38cf0907ab5b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:45.583716 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-db5ebc24-1e53-46a8-8681-38cf0907ab5b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:45.584147 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-db5ebc24-1e53-46a8-8681-38cf0907ab5b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:45.585624 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-db5ebc24-1e53-46a8-8681-38cf0907ab5b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:45.586430 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-db5ebc24-1e53-46a8-8681-38cf0907ab5b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:45.587131 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-db5ebc24-1e53-46a8-8681-38cf0907ab5b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:45.733039 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-db5ebc24-1e53-46a8-8681-38cf0907ab5b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:45.741749 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-db5ebc24-1e53-46a8-8681-38cf0907ab5b tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.169588 Nov 02 07:37:45.742304 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 450/897] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:45 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:46.765221 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a9412a87-c21a-45d1-acc2-eea679f9a808 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:46.765851 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a9412a87-c21a-45d1-acc2-eea679f9a808 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:46.771946 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a9412a87-c21a-45d1-acc2-eea679f9a808 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:46.772722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a9412a87-c21a-45d1-acc2-eea679f9a808 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:46.773150 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a9412a87-c21a-45d1-acc2-eea679f9a808 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:46.773859 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a9412a87-c21a-45d1-acc2-eea679f9a808 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:46.774291 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a9412a87-c21a-45d1-acc2-eea679f9a808 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:46.774733 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a9412a87-c21a-45d1-acc2-eea679f9a808 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:46.922557 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a9412a87-c21a-45d1-acc2-eea679f9a808 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:46.931496 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a9412a87-c21a-45d1-acc2-eea679f9a808 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.170216 Nov 02 07:37:46.932057 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 448/898] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:46 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:47.954821 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-a0c6490c-912a-4cd0-8812-bdc8d8cc9692 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:47.955352 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-a0c6490c-912a-4cd0-8812-bdc8d8cc9692 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:47.962228 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a0c6490c-912a-4cd0-8812-bdc8d8cc9692 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:47.962740 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a0c6490c-912a-4cd0-8812-bdc8d8cc9692 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:47.963204 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a0c6490c-912a-4cd0-8812-bdc8d8cc9692 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:47.963891 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a0c6490c-912a-4cd0-8812-bdc8d8cc9692 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:47.964345 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a0c6490c-912a-4cd0-8812-bdc8d8cc9692 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:47.964771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-a0c6490c-912a-4cd0-8812-bdc8d8cc9692 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:48.108847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-a0c6490c-912a-4cd0-8812-bdc8d8cc9692 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:48.117037 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-a0c6490c-912a-4cd0-8812-bdc8d8cc9692 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.166326 Nov 02 07:37:48.117586 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 451/899] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:47 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:49.140136 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f9978be2-bc8f-400c-82e0-daa77b3ca686 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:49.140748 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f9978be2-bc8f-400c-82e0-daa77b3ca686 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:49.147083 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9978be2-bc8f-400c-82e0-daa77b3ca686 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:49.147561 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9978be2-bc8f-400c-82e0-daa77b3ca686 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:49.147985 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9978be2-bc8f-400c-82e0-daa77b3ca686 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:49.149440 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9978be2-bc8f-400c-82e0-daa77b3ca686 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:49.149886 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9978be2-bc8f-400c-82e0-daa77b3ca686 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:49.150322 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9978be2-bc8f-400c-82e0-daa77b3ca686 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:49.298782 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f9978be2-bc8f-400c-82e0-daa77b3ca686 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:49.307665 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f9978be2-bc8f-400c-82e0-daa77b3ca686 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.171357 Nov 02 07:37:49.315766 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 449/900] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:49 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:50.332441 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-91f9e19f-14fa-4c42-a791-a442d31d9f7f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:50.333056 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-91f9e19f-14fa-4c42-a791-a442d31d9f7f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:50.339936 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91f9e19f-14fa-4c42-a791-a442d31d9f7f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:50.340412 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91f9e19f-14fa-4c42-a791-a442d31d9f7f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:50.340846 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91f9e19f-14fa-4c42-a791-a442d31d9f7f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:50.341530 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91f9e19f-14fa-4c42-a791-a442d31d9f7f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:50.341979 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91f9e19f-14fa-4c42-a791-a442d31d9f7f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:50.342429 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91f9e19f-14fa-4c42-a791-a442d31d9f7f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:50.489924 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-91f9e19f-14fa-4c42-a791-a442d31d9f7f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:50.499096 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-91f9e19f-14fa-4c42-a791-a442d31d9f7f tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.170559 Nov 02 07:37:50.499827 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 452/901] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:50 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:51.524169 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-310c6bc3-e111-429e-a976-85fb7c940885 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:51.524816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-310c6bc3-e111-429e-a976-85fb7c940885 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:51.531355 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-310c6bc3-e111-429e-a976-85fb7c940885 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:51.531840 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-310c6bc3-e111-429e-a976-85fb7c940885 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:51.532281 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-310c6bc3-e111-429e-a976-85fb7c940885 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:51.532972 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-310c6bc3-e111-429e-a976-85fb7c940885 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:51.533426 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-310c6bc3-e111-429e-a976-85fb7c940885 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:51.533847 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-310c6bc3-e111-429e-a976-85fb7c940885 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:51.687077 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-310c6bc3-e111-429e-a976-85fb7c940885 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:51.697476 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-310c6bc3-e111-429e-a976-85fb7c940885 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.177437 Nov 02 07:37:51.698064 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 450/902] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:51 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:52.724651 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-1ce63b39-bbe2-4f64-9462-4ebc825c50a6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:52.725263 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-1ce63b39-bbe2-4f64-9462-4ebc825c50a6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:52.732336 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1ce63b39-bbe2-4f64-9462-4ebc825c50a6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:52.732809 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1ce63b39-bbe2-4f64-9462-4ebc825c50a6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:52.733291 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1ce63b39-bbe2-4f64-9462-4ebc825c50a6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:52.733973 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1ce63b39-bbe2-4f64-9462-4ebc825c50a6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:52.734440 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1ce63b39-bbe2-4f64-9462-4ebc825c50a6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:52.734860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1ce63b39-bbe2-4f64-9462-4ebc825c50a6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:52.883607 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-1ce63b39-bbe2-4f64-9462-4ebc825c50a6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:52.892184 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-1ce63b39-bbe2-4f64-9462-4ebc825c50a6 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1756 microversion: 2.1 time: 0.171409 Nov 02 07:37:52.892750 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 453/903] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:52 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:53.915047 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ad89c757-6f6c-4082-be3a-189544b67362 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:53.915615 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ad89c757-6f6c-4082-be3a-189544b67362 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:53.921963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ad89c757-6f6c-4082-be3a-189544b67362 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:53.922472 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ad89c757-6f6c-4082-be3a-189544b67362 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:53.922899 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ad89c757-6f6c-4082-be3a-189544b67362 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:53.923579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ad89c757-6f6c-4082-be3a-189544b67362 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:53.924025 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ad89c757-6f6c-4082-be3a-189544b67362 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:53.924442 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ad89c757-6f6c-4082-be3a-189544b67362 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:54.067332 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ad89c757-6f6c-4082-be3a-189544b67362 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:54.076093 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ad89c757-6f6c-4082-be3a-189544b67362 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1759 microversion: 2.1 time: 0.165198 Nov 02 07:37:54.076697 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 451/904] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:53 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:54.877605 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-9afc8156-8152-49a0-a1f2-d57c41bb6251 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:37:54.884823 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9afc8156-8152-49a0-a1f2-d57c41bb6251 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:54.885607 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9afc8156-8152-49a0-a1f2-d57c41bb6251 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:54.885949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9afc8156-8152-49a0-a1f2-d57c41bb6251 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:54.948758 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-9afc8156-8152-49a0-a1f2-d57c41bb6251 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Going to try to stop instance {{(pid=118991) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 07:37:54.995341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-9afc8156-8152-49a0-a1f2-d57c41bb6251 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "POST /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/action" status: 202 len: 0 microversion: 2.1 time: 0.120466 Nov 02 07:37:54.996156 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 454/905] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 07:37:54 2022] POST /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:37:55.004618 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a60d2407-8755-4157-811e-6a63df9d2454 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:55.005286 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a60d2407-8755-4157-811e-6a63df9d2454 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:55.013050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a60d2407-8755-4157-811e-6a63df9d2454 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:55.013555 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a60d2407-8755-4157-811e-6a63df9d2454 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:55.013988 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a60d2407-8755-4157-811e-6a63df9d2454 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:55.014706 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a60d2407-8755-4157-811e-6a63df9d2454 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:55.015163 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a60d2407-8755-4157-811e-6a63df9d2454 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:55.015589 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a60d2407-8755-4157-811e-6a63df9d2454 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:55.151249 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a60d2407-8755-4157-811e-6a63df9d2454 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:55.159823 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a60d2407-8755-4157-811e-6a63df9d2454 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1721 microversion: 2.1 time: 0.159164 Nov 02 07:37:55.160631 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 452/906] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:54 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:56.185034 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-91853f58-f3ba-4475-ac70-b43da7c18673 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:56.185798 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-91853f58-f3ba-4475-ac70-b43da7c18673 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:56.192135 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91853f58-f3ba-4475-ac70-b43da7c18673 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:56.192621 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91853f58-f3ba-4475-ac70-b43da7c18673 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:56.193055 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91853f58-f3ba-4475-ac70-b43da7c18673 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:56.193754 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91853f58-f3ba-4475-ac70-b43da7c18673 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:56.194204 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91853f58-f3ba-4475-ac70-b43da7c18673 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:56.194653 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-91853f58-f3ba-4475-ac70-b43da7c18673 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:56.199576 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:56.331170 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-91853f58-f3ba-4475-ac70-b43da7c18673 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:56.340046 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-91853f58-f3ba-4475-ac70-b43da7c18673 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1721 microversion: 2.1 time: 0.160432 Nov 02 07:37:56.340618 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 455/907] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:56 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:57.364709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7ebfcccf-d7da-4149-aaf9-30e6c1d7c97b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:57.365331 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-7ebfcccf-d7da-4149-aaf9-30e6c1d7c97b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:57.372945 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7ebfcccf-d7da-4149-aaf9-30e6c1d7c97b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:57.373440 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7ebfcccf-d7da-4149-aaf9-30e6c1d7c97b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:57.373877 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7ebfcccf-d7da-4149-aaf9-30e6c1d7c97b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:57.374619 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7ebfcccf-d7da-4149-aaf9-30e6c1d7c97b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:57.375072 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7ebfcccf-d7da-4149-aaf9-30e6c1d7c97b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:57.375499 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7ebfcccf-d7da-4149-aaf9-30e6c1d7c97b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:57.508777 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-7ebfcccf-d7da-4149-aaf9-30e6c1d7c97b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:57.517202 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-7ebfcccf-d7da-4149-aaf9-30e6c1d7c97b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1721 microversion: 2.1 time: 0.156630 Nov 02 07:37:57.517757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 453/908] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:57 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:58.543937 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-45119e8b-5156-4ba6-bc31-34038c1f23e5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:58.544549 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-45119e8b-5156-4ba6-bc31-34038c1f23e5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:58.546882 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=29 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:58.552207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-45119e8b-5156-4ba6-bc31-34038c1f23e5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:58.552687 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-45119e8b-5156-4ba6-bc31-34038c1f23e5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:58.553123 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-45119e8b-5156-4ba6-bc31-34038c1f23e5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:58.553807 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-45119e8b-5156-4ba6-bc31-34038c1f23e5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:58.554257 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-45119e8b-5156-4ba6-bc31-34038c1f23e5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:58.554706 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-45119e8b-5156-4ba6-bc31-34038c1f23e5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:58.694529 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-45119e8b-5156-4ba6-bc31-34038c1f23e5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:58.703636 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-45119e8b-5156-4ba6-bc31-34038c1f23e5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1721 microversion: 2.1 time: 0.164217 Nov 02 07:37:58.704223 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 456/909] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:58 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:37:59.728513 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-643a8f2b-a7cb-4a29-9b1a-5c3ebfba788d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:37:59.729120 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-643a8f2b-a7cb-4a29-9b1a-5c3ebfba788d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:37:59.731456 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=31 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:59.736623 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-643a8f2b-a7cb-4a29-9b1a-5c3ebfba788d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:59.737105 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-643a8f2b-a7cb-4a29-9b1a-5c3ebfba788d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:59.737539 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-643a8f2b-a7cb-4a29-9b1a-5c3ebfba788d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:59.738232 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-643a8f2b-a7cb-4a29-9b1a-5c3ebfba788d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:37:59.738711 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-643a8f2b-a7cb-4a29-9b1a-5c3ebfba788d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:37:59.739242 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-643a8f2b-a7cb-4a29-9b1a-5c3ebfba788d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:37:59.742327 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=89 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:59.876396 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-643a8f2b-a7cb-4a29-9b1a-5c3ebfba788d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:37:59.884665 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-643a8f2b-a7cb-4a29-9b1a-5c3ebfba788d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1721 microversion: 2.1 time: 0.160060 Nov 02 07:37:59.886249 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 454/910] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:37:59 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:00.908936 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-837d3f5b-d1ed-4b52-a026-b502b029993e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:00.909545 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-837d3f5b-d1ed-4b52-a026-b502b029993e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:00.916704 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-837d3f5b-d1ed-4b52-a026-b502b029993e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:00.917166 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-837d3f5b-d1ed-4b52-a026-b502b029993e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:00.917685 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-837d3f5b-d1ed-4b52-a026-b502b029993e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:00.918451 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-837d3f5b-d1ed-4b52-a026-b502b029993e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:00.918938 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-837d3f5b-d1ed-4b52-a026-b502b029993e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:00.919399 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-837d3f5b-d1ed-4b52-a026-b502b029993e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:01.053856 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-837d3f5b-d1ed-4b52-a026-b502b029993e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:01.062787 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-837d3f5b-d1ed-4b52-a026-b502b029993e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1721 microversion: 2.1 time: 0.157689 Nov 02 07:38:01.063346 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 457/911] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:00 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:02.086498 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d8ec4d2c-2d1a-4790-b986-2a3c3465019f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:02.087326 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-d8ec4d2c-2d1a-4790-b986-2a3c3465019f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:02.095408 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d8ec4d2c-2d1a-4790-b986-2a3c3465019f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:02.095894 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d8ec4d2c-2d1a-4790-b986-2a3c3465019f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:02.096329 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d8ec4d2c-2d1a-4790-b986-2a3c3465019f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:02.097036 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d8ec4d2c-2d1a-4790-b986-2a3c3465019f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:02.097491 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d8ec4d2c-2d1a-4790-b986-2a3c3465019f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:02.097915 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d8ec4d2c-2d1a-4790-b986-2a3c3465019f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:02.237111 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-d8ec4d2c-2d1a-4790-b986-2a3c3465019f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:02.246255 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-d8ec4d2c-2d1a-4790-b986-2a3c3465019f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1721 microversion: 2.1 time: 0.163627 Nov 02 07:38:02.246900 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 455/912] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:02 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:38:03.273916 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-522c381c-707a-4eca-9b8f-888ef9fbdd06 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:03.274556 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-522c381c-707a-4eca-9b8f-888ef9fbdd06 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:03.281742 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-522c381c-707a-4eca-9b8f-888ef9fbdd06 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:03.282212 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-522c381c-707a-4eca-9b8f-888ef9fbdd06 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:03.282680 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-522c381c-707a-4eca-9b8f-888ef9fbdd06 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:03.283352 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-522c381c-707a-4eca-9b8f-888ef9fbdd06 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:03.283800 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-522c381c-707a-4eca-9b8f-888ef9fbdd06 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:03.284211 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-522c381c-707a-4eca-9b8f-888ef9fbdd06 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:03.414040 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-522c381c-707a-4eca-9b8f-888ef9fbdd06 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:03.422865 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-522c381c-707a-4eca-9b8f-888ef9fbdd06 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1721 microversion: 2.1 time: 0.152929 Nov 02 07:38:03.423425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 458/913] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:03 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:04.446059 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-38ca23ab-1873-4c19-ab69-2cff9b8c5852 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:04.446688 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-38ca23ab-1873-4c19-ab69-2cff9b8c5852 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:04.453173 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-38ca23ab-1873-4c19-ab69-2cff9b8c5852 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:04.453653 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-38ca23ab-1873-4c19-ab69-2cff9b8c5852 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:04.454084 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-38ca23ab-1873-4c19-ab69-2cff9b8c5852 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:04.454791 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-38ca23ab-1873-4c19-ab69-2cff9b8c5852 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:04.455249 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-38ca23ab-1873-4c19-ab69-2cff9b8c5852 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:04.455693 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-38ca23ab-1873-4c19-ab69-2cff9b8c5852 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:04.586716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-38ca23ab-1873-4c19-ab69-2cff9b8c5852 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:04.595339 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-38ca23ab-1873-4c19-ab69-2cff9b8c5852 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1721 microversion: 2.1 time: 0.153147 Nov 02 07:38:04.595898 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 456/914] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:04 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:05.618586 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-4d3bf932-0ca9-4056-bbe6-6fe53a593e0d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:05.619178 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-4d3bf932-0ca9-4056-bbe6-6fe53a593e0d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:05.627335 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d3bf932-0ca9-4056-bbe6-6fe53a593e0d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:05.627901 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d3bf932-0ca9-4056-bbe6-6fe53a593e0d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:05.628379 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d3bf932-0ca9-4056-bbe6-6fe53a593e0d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:05.629614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d3bf932-0ca9-4056-bbe6-6fe53a593e0d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:05.630196 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d3bf932-0ca9-4056-bbe6-6fe53a593e0d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:05.630653 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4d3bf932-0ca9-4056-bbe6-6fe53a593e0d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:05.764564 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-4d3bf932-0ca9-4056-bbe6-6fe53a593e0d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:05.772703 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-4d3bf932-0ca9-4056-bbe6-6fe53a593e0d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1698 microversion: 2.1 time: 0.158119 Nov 02 07:38:05.773263 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 459/915] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:05 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:05.796000 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-8e41b02a-8e40-45fc-96d7-df2a57d7a98c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:38:05.802416 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8e41b02a-8e40-45fc-96d7-df2a57d7a98c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:05.802898 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8e41b02a-8e40-45fc-96d7-df2a57d7a98c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:05.803324 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-8e41b02a-8e40-45fc-96d7-df2a57d7a98c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:05.865716 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-8e41b02a-8e40-45fc-96d7-df2a57d7a98c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Going to try to start instance {{(pid=118992) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 07:38:05.907691 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-8e41b02a-8e40-45fc-96d7-df2a57d7a98c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "POST /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/action" status: 202 len: 0 microversion: 2.1 time: 0.116087 Nov 02 07:38:05.908216 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 457/916] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 07:38:05 2022] POST /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:38:05.916850 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-71a17dbf-abeb-4814-b4ab-1cfedc35ef80 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:05.917976 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-71a17dbf-abeb-4814-b4ab-1cfedc35ef80 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:05.924291 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-71a17dbf-abeb-4814-b4ab-1cfedc35ef80 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:05.924826 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-71a17dbf-abeb-4814-b4ab-1cfedc35ef80 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:05.925266 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-71a17dbf-abeb-4814-b4ab-1cfedc35ef80 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:05.926020 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-71a17dbf-abeb-4814-b4ab-1cfedc35ef80 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:05.926560 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-71a17dbf-abeb-4814-b4ab-1cfedc35ef80 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:05.926991 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-71a17dbf-abeb-4814-b4ab-1cfedc35ef80 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:06.067399 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-71a17dbf-abeb-4814-b4ab-1cfedc35ef80 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:06.076988 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-71a17dbf-abeb-4814-b4ab-1cfedc35ef80 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1707 microversion: 2.1 time: 0.164530 Nov 02 07:38:06.077575 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 460/917] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:05 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1707 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:07.102042 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-bc4cf73e-cc39-489d-b2e9-0746424e369c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:07.102763 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-bc4cf73e-cc39-489d-b2e9-0746424e369c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:07.109088 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bc4cf73e-cc39-489d-b2e9-0746424e369c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:07.109573 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bc4cf73e-cc39-489d-b2e9-0746424e369c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:07.110035 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bc4cf73e-cc39-489d-b2e9-0746424e369c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:07.110763 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bc4cf73e-cc39-489d-b2e9-0746424e369c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:07.111212 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bc4cf73e-cc39-489d-b2e9-0746424e369c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:07.111635 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-bc4cf73e-cc39-489d-b2e9-0746424e369c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:07.242135 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-bc4cf73e-cc39-489d-b2e9-0746424e369c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:07.250523 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-bc4cf73e-cc39-489d-b2e9-0746424e369c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1707 microversion: 2.1 time: 0.153363 Nov 02 07:38:07.251090 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 458/918] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:07 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1707 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:08.273742 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2646ebcf-6b60-4eb4-9921-895ba85c3853 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:08.274348 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2646ebcf-6b60-4eb4-9921-895ba85c3853 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:08.281142 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2646ebcf-6b60-4eb4-9921-895ba85c3853 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:08.281648 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2646ebcf-6b60-4eb4-9921-895ba85c3853 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:08.282113 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2646ebcf-6b60-4eb4-9921-895ba85c3853 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:08.282834 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2646ebcf-6b60-4eb4-9921-895ba85c3853 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:08.283287 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2646ebcf-6b60-4eb4-9921-895ba85c3853 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:08.283712 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2646ebcf-6b60-4eb4-9921-895ba85c3853 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:08.421256 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-2646ebcf-6b60-4eb4-9921-895ba85c3853 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:08.439485 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2646ebcf-6b60-4eb4-9921-895ba85c3853 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1711 microversion: 2.1 time: 0.169515 Nov 02 07:38:08.440140 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 461/919] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:08 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1711 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:18.277985 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-af2f1ee5-d37e-4863-88b5-6269da9b889b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:18.283988 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-b5112b0e-4a77-44b9-abc1-5d75603dab6f req-4bd6fab7-5a6c-4971-8d2f-0d48140a01c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f0c6bc8-dd75-40d4-8aa9-db602c43827f", "tag": "a8803367-51f8-419d-a4e7-a51526460bb6"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:38:18.289409 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-af2f1ee5-d37e-4863-88b5-6269da9b889b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:18.292044 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=11 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:18.292306 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=9 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:18.293087 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:18.298093 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af2f1ee5-d37e-4863-88b5-6269da9b889b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:18.298693 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af2f1ee5-d37e-4863-88b5-6269da9b889b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:18.299217 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af2f1ee5-d37e-4863-88b5-6269da9b889b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:18.299569 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-b5112b0e-4a77-44b9-abc1-5d75603dab6f req-4bd6fab7-5a6c-4971-8d2f-0d48140a01c1 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:18.300045 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-b5112b0e-4a77-44b9-abc1-5d75603dab6f req-4bd6fab7-5a6c-4971-8d2f-0d48140a01c1 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:18.300176 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af2f1ee5-d37e-4863-88b5-6269da9b889b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:18.300470 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-b5112b0e-4a77-44b9-abc1-5d75603dab6f req-4bd6fab7-5a6c-4971-8d2f-0d48140a01c1 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:18.300886 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af2f1ee5-d37e-4863-88b5-6269da9b889b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:18.301320 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-af2f1ee5-d37e-4863-88b5-6269da9b889b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:18.312880 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-b5112b0e-4a77-44b9-abc1-5d75603dab6f req-4bd6fab7-5a6c-4971-8d2f-0d48140a01c1 service nova] Creating event network-changed:a8803367-51f8-419d-a4e7-a51526460bb6 for instance 8f0c6bc8-dd75-40d4-8aa9-db602c43827f on hv-cinder-80473 Nov 02 07:38:18.318742 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-b5112b0e-4a77-44b9-abc1-5d75603dab6f req-4bd6fab7-5a6c-4971-8d2f-0d48140a01c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037850 Nov 02 07:38:18.319333 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 462/920] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:38:18.328859 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-af2f1ee5-d37e-4863-88b5-6269da9b889b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Going to try to terminate instance {{(pid=118992) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:38:18.415809 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-af2f1ee5-d37e-4863-88b5-6269da9b889b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 204 len: 0 microversion: 2.1 time: 0.141315 Nov 02 07:38:18.417539 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 459/921] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:38:18 2022] DELETE /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:38:18.426330 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-729ac0e0-5f2a-409a-9553-bb8de47ff08b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:18.427062 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-729ac0e0-5f2a-409a-9553-bb8de47ff08b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:18.433471 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-729ac0e0-5f2a-409a-9553-bb8de47ff08b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:18.433958 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-729ac0e0-5f2a-409a-9553-bb8de47ff08b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:18.434425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-729ac0e0-5f2a-409a-9553-bb8de47ff08b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:18.435871 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-729ac0e0-5f2a-409a-9553-bb8de47ff08b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:18.436374 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-729ac0e0-5f2a-409a-9553-bb8de47ff08b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:18.436868 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-729ac0e0-5f2a-409a-9553-bb8de47ff08b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:18.587447 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-729ac0e0-5f2a-409a-9553-bb8de47ff08b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:18.597662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-729ac0e0-5f2a-409a-9553-bb8de47ff08b tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1579 microversion: 2.1 time: 0.174461 Nov 02 07:38:18.598719 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 463/922] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:18 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1579 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:19.621429 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-622da54f-cb25-4bdd-8fa2-5a0e2995bc54 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:19.622155 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-622da54f-cb25-4bdd-8fa2-5a0e2995bc54 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:19.628603 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-622da54f-cb25-4bdd-8fa2-5a0e2995bc54 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:19.629090 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-622da54f-cb25-4bdd-8fa2-5a0e2995bc54 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:19.629532 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-622da54f-cb25-4bdd-8fa2-5a0e2995bc54 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:19.630233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-622da54f-cb25-4bdd-8fa2-5a0e2995bc54 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:19.630728 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-622da54f-cb25-4bdd-8fa2-5a0e2995bc54 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:19.631152 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-622da54f-cb25-4bdd-8fa2-5a0e2995bc54 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:19.837172 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-622da54f-cb25-4bdd-8fa2-5a0e2995bc54 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:19.844863 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-622da54f-cb25-4bdd-8fa2-5a0e2995bc54 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1579 microversion: 2.1 time: 0.227642 Nov 02 07:38:19.845425 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 460/923] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:19 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1579 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:20.870419 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-07d2ded2-1855-4b47-bf34-e1cfb67efa7f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:20.871261 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-07d2ded2-1855-4b47-bf34-e1cfb67efa7f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:20.879937 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07d2ded2-1855-4b47-bf34-e1cfb67efa7f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:20.880608 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07d2ded2-1855-4b47-bf34-e1cfb67efa7f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:20.881307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07d2ded2-1855-4b47-bf34-e1cfb67efa7f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:20.882158 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07d2ded2-1855-4b47-bf34-e1cfb67efa7f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:20.890402 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-3af9b2ad-e90f-49b1-8ca5-ece840a5f0e0 req-120e79dc-346d-4a4c-9c52-2572b757719c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f0c6bc8-dd75-40d4-8aa9-db602c43827f", "name": "network-vif-deleted", "tag": "a8803367-51f8-419d-a4e7-a51526460bb6"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:38:20.894070 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07d2ded2-1855-4b47-bf34-e1cfb67efa7f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:20.894697 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07d2ded2-1855-4b47-bf34-e1cfb67efa7f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:20.907570 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-3af9b2ad-e90f-49b1-8ca5-ece840a5f0e0 req-120e79dc-346d-4a4c-9c52-2572b757719c service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:20.908060 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-3af9b2ad-e90f-49b1-8ca5-ece840a5f0e0 req-120e79dc-346d-4a4c-9c52-2572b757719c service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:20.908491 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-3af9b2ad-e90f-49b1-8ca5-ece840a5f0e0 req-120e79dc-346d-4a4c-9c52-2572b757719c service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:20.922680 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-3af9b2ad-e90f-49b1-8ca5-ece840a5f0e0 req-120e79dc-346d-4a4c-9c52-2572b757719c service nova] Creating event network-vif-deleted:a8803367-51f8-419d-a4e7-a51526460bb6 for instance 8f0c6bc8-dd75-40d4-8aa9-db602c43827f on hv-cinder-80473 Nov 02 07:38:20.929385 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-3af9b2ad-e90f-49b1-8ca5-ece840a5f0e0 req-120e79dc-346d-4a4c-9c52-2572b757719c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043517 Nov 02 07:38:20.933257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 461/924] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:38:20.968139 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-07d2ded2-1855-4b47-bf34-e1cfb67efa7f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:20.978609 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-07d2ded2-1855-4b47-bf34-e1cfb67efa7f tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 200 len: 1392 microversion: 2.1 time: 0.112009 Nov 02 07:38:20.990702 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 464/925] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:20 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 1392 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:22.004936 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-56307fc4-c328-42e5-b540-bb9fc2383770 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:22.005658 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-56307fc4-c328-42e5-b540-bb9fc2383770 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 8f0c6bc8-dd75-40d4-8aa9-db602c43827f] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:22.012128 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-56307fc4-c328-42e5-b540-bb9fc2383770 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:22.012611 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-56307fc4-c328-42e5-b540-bb9fc2383770 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:22.013045 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-56307fc4-c328-42e5-b540-bb9fc2383770 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:22.013736 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-56307fc4-c328-42e5-b540-bb9fc2383770 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:22.014906 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-56307fc4-c328-42e5-b540-bb9fc2383770 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:22.015338 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-56307fc4-c328-42e5-b540-bb9fc2383770 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:22.028693 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-56307fc4-c328-42e5-b540-bb9fc2383770 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] HTTP exception thrown: Instance 8f0c6bc8-dd75-40d4-8aa9-db602c43827f could not be found. Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-56307fc4-c328-42e5-b540-bb9fc2383770 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Request method failure captured: Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f HTTP/1.1 Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhyTWk-O_OqLu_QeVTQLGezpCiVh9Jp0zHNg2lqfT0Png45XS8EJWyhymALQ_6L6XTxU4HFylmj21NenAQlCkR84qrUm5z1Lzuu7Dh1GHFETRqOJvY3lOx3YMLbR2dPAhbN8QKpf63w7T_Rznuj0YxzoXwF5Rmr0Z1LIXpdwGvvj_W0 Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: 566514b413e24aaebe69c11ce2159ac9 Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-TestVolumeBootPattern-383952907 Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:38:22.030979 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:38:22.032579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_566514b413e24aaebe69c11ce2159ac9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/566514b413e24aaebe69c11ce2159ac9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/566514b413e24aaebe69c11ce2159ac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/566514b413e24aaebe69c11ce2159ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:38:22.032579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-TestVolumeBootPattern-383952907 Nov 02 07:38:22.032579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: 566514b413e24aaebe69c11ce2159ac9 Nov 02 07:38:22.032579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-TestVolumeBootPattern-383952907 Nov 02 07:38:22.032579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-TestVolumeBootPattern-383952907-project Nov 02 07:38:22.032579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:38:22.032579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:38:22.032579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: fe26aea6bb9d4dcebf046da719b2c244 Nov 02 07:38:22.032579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-TestVolumeBootPattern-383952907-project Nov 02 07:38:22.032579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:38:22.032579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 8f0c6bc8-dd75-40d4-8aa9-db602c43827f could not be found. Nov 02 07:38:22.032579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '8f0c6bc8-dd75-40d4-8aa9-db602c43827f'} Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f0c6bc8-dd75-40d4-8aa9-db602c43827f could not be found. Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:38:22.033506 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f0c6bc8-dd75-40d4-8aa9-db602c43827f could not be found. Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f0c6bc8-dd75-40d4-8aa9-db602c43827f could not be found. Nov 02 07:38:22.035050 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:38:22.036818 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-56307fc4-c328-42e5-b540-bb9fc2383770 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Returning 404 to user: Instance 8f0c6bc8-dd75-40d4-8aa9-db602c43827f could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:38:22.036818 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-56307fc4-c328-42e5-b540-bb9fc2383770 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f" status: 404 len: 111 microversion: 2.1 time: 0.032408 Nov 02 07:38:22.036818 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 462/926] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:21 2022] GET /compute/v2.1/servers/8f0c6bc8-dd75-40d4-8aa9-db602c43827f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:38:25.402214 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-68f9d095-94be-41f1-9ba7-43cd79a1b507 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:25.402727 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-68f9d095-94be-41f1-9ba7-43cd79a1b507 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:25.411724 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-85362514-7250-4d7c-b69e-a9625c2bf010 req-42ac6c04-184f-46ee-8d4f-2dfdc3828dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b63e70e7-b2ef-4b6e-9457-7f92d1adc30b", "tag": "5170ac1a-792e-408b-9e77-31d91e95efd5"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:38:25.420946 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-68f9d095-94be-41f1-9ba7-43cd79a1b507 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:25.421442 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-68f9d095-94be-41f1-9ba7-43cd79a1b507 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:25.421872 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-68f9d095-94be-41f1-9ba7-43cd79a1b507 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:25.422757 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-68f9d095-94be-41f1-9ba7-43cd79a1b507 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:25.423209 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-68f9d095-94be-41f1-9ba7-43cd79a1b507 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:25.427053 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-85362514-7250-4d7c-b69e-a9625c2bf010 req-42ac6c04-184f-46ee-8d4f-2dfdc3828dc9 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:25.427524 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-85362514-7250-4d7c-b69e-a9625c2bf010 req-42ac6c04-184f-46ee-8d4f-2dfdc3828dc9 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:25.427947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-85362514-7250-4d7c-b69e-a9625c2bf010 req-42ac6c04-184f-46ee-8d4f-2dfdc3828dc9 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:25.428587 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-68f9d095-94be-41f1-9ba7-43cd79a1b507 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:25.450080 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-85362514-7250-4d7c-b69e-a9625c2bf010 req-42ac6c04-184f-46ee-8d4f-2dfdc3828dc9 service nova] Creating event network-changed:5170ac1a-792e-408b-9e77-31d91e95efd5 for instance b63e70e7-b2ef-4b6e-9457-7f92d1adc30b on hv-cinder-80473 Nov 02 07:38:25.456472 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-85362514-7250-4d7c-b69e-a9625c2bf010 req-42ac6c04-184f-46ee-8d4f-2dfdc3828dc9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048714 Nov 02 07:38:25.457161 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 463/927] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:38:25.461240 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-68f9d095-94be-41f1-9ba7-43cd79a1b507 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Going to try to terminate instance {{(pid=118991) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:38:25.566508 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-68f9d095-94be-41f1-9ba7-43cd79a1b507 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 204 len: 0 microversion: 2.1 time: 0.168183 Nov 02 07:38:25.574512 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 465/928] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:38:25 2022] DELETE /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:38:25.578350 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-6128c604-4dcd-4461-8e29-c2794890ba9c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:25.579431 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-6128c604-4dcd-4461-8e29-c2794890ba9c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:25.588641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6128c604-4dcd-4461-8e29-c2794890ba9c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:25.589267 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6128c604-4dcd-4461-8e29-c2794890ba9c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:25.589761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6128c604-4dcd-4461-8e29-c2794890ba9c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:25.590606 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6128c604-4dcd-4461-8e29-c2794890ba9c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:25.591109 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6128c604-4dcd-4461-8e29-c2794890ba9c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:25.591947 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-6128c604-4dcd-4461-8e29-c2794890ba9c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:25.741106 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-6128c604-4dcd-4461-8e29-c2794890ba9c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:25.750101 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-6128c604-4dcd-4461-8e29-c2794890ba9c tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1577 microversion: 2.1 time: 0.177670 Nov 02 07:38:25.752169 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 464/929] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:25 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:26.776524 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-3b403f14-cb11-4e76-b0f7-c20957eef5d4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:26.777252 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-3b403f14-cb11-4e76-b0f7-c20957eef5d4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:26.783702 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3b403f14-cb11-4e76-b0f7-c20957eef5d4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:26.784185 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3b403f14-cb11-4e76-b0f7-c20957eef5d4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:26.784617 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3b403f14-cb11-4e76-b0f7-c20957eef5d4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:26.785308 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3b403f14-cb11-4e76-b0f7-c20957eef5d4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:26.785760 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3b403f14-cb11-4e76-b0f7-c20957eef5d4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:26.786184 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3b403f14-cb11-4e76-b0f7-c20957eef5d4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:26.790243 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:26.993380 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-3b403f14-cb11-4e76-b0f7-c20957eef5d4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:27.007376 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-3b403f14-cb11-4e76-b0f7-c20957eef5d4 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1577 microversion: 2.1 time: 0.235020 Nov 02 07:38:27.008166 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 466/930] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:26 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1577 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:28.030792 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-81b7d744-0674-4225-999f-19ef0b1ddf0a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:28.031383 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-81b7d744-0674-4225-999f-19ef0b1ddf0a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:28.038395 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81b7d744-0674-4225-999f-19ef0b1ddf0a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:28.039074 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81b7d744-0674-4225-999f-19ef0b1ddf0a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:28.039511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81b7d744-0674-4225-999f-19ef0b1ddf0a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:28.040210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81b7d744-0674-4225-999f-19ef0b1ddf0a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:28.040665 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81b7d744-0674-4225-999f-19ef0b1ddf0a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:28.041090 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-81b7d744-0674-4225-999f-19ef0b1ddf0a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:28.055662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-968997500", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452", "networks": [{"uuid": "25540d19-7bb3-4b5f-b387-4dee03cfded6"}]}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:38:28.111115 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.network.neutron [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] validate_networks() for [('25540d19-7bb3-4b5f-b387-4dee03cfded6', None, None, None, None, None)] {{(pid=118991) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:38:28.377720 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-81b7d744-0674-4225-999f-19ef0b1ddf0a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe26aea6bb9d4dcebf046da719b2c244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566514b413e24aaebe69c11ce2159ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:28.385699 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-81b7d744-0674-4225-999f-19ef0b1ddf0a tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 200 len: 1458 microversion: 2.1 time: 0.358709 Nov 02 07:38:28.386269 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 465/931] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:28 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 1458 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:28.399511 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-fa620f4e-4e81-4787-b9aa-4f44d3c46dd0 req-b57fc38c-4145-408e-8dd5-ba83df822b39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b63e70e7-b2ef-4b6e-9457-7f92d1adc30b", "name": "network-vif-deleted", "tag": "5170ac1a-792e-408b-9e77-31d91e95efd5"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:38:28.411239 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-fa620f4e-4e81-4787-b9aa-4f44d3c46dd0 req-b57fc38c-4145-408e-8dd5-ba83df822b39 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:28.411809 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-fa620f4e-4e81-4787-b9aa-4f44d3c46dd0 req-b57fc38c-4145-408e-8dd5-ba83df822b39 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:28.412315 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-fa620f4e-4e81-4787-b9aa-4f44d3c46dd0 req-b57fc38c-4145-408e-8dd5-ba83df822b39 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:28.423918 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-fa620f4e-4e81-4787-b9aa-4f44d3c46dd0 req-b57fc38c-4145-408e-8dd5-ba83df822b39 service nova] Creating event network-vif-deleted:5170ac1a-792e-408b-9e77-31d91e95efd5 for instance b63e70e7-b2ef-4b6e-9457-7f92d1adc30b on hv-cinder-80473 Nov 02 07:38:28.428995 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-fa620f4e-4e81-4787-b9aa-4f44d3c46dd0 req-b57fc38c-4145-408e-8dd5-ba83df822b39 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040985 Nov 02 07:38:28.429832 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 466/932] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:38:28.612813 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Flavor limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:38:28.613251 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Image limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:38:28.613722 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Flavor pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:38:28.614199 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Image pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:38:28.614638 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:38:28.626010 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:28.626714 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:28.627437 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:28.628431 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:28.629119 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:28.629794 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:28.655840 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Getting quotas for project 5c30df4815d74ad3a0805a7e0ee259a6. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:38:28.661149 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Getting quotas for user 8c67a36d80e845818623cd258a3456fa and project 5c30df4815d74ad3a0805a7e0ee259a6. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:38:28.676080 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Going to run 1 instances... {{(pid=118991) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:38:28.678771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:38:28.729765 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-4ada07be-c417-4243-9674-73b86f9e6432 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680614 Nov 02 07:38:28.738021 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 467/933] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:38:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 07:38:28.743772 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-3f908dfd-b686-4dcf-982c-c2e0bd75c7d0 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:28.744740 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-3f908dfd-b686-4dcf-982c-c2e0bd75c7d0 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:28.807862 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-3f908dfd-b686-4dcf-982c-c2e0bd75c7d0 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:28.815991 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-3f908dfd-b686-4dcf-982c-c2e0bd75c7d0 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560" status: 200 len: 1218 microversion: 2.1 time: 0.076636 Nov 02 07:38:28.816686 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 467/934] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:28 2022] GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:38:29.411803 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-9285f964-0c69-46ac-8ae5-005cae34d781 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:29.413109 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-9285f964-0c69-46ac-8ae5-005cae34d781 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: b63e70e7-b2ef-4b6e-9457-7f92d1adc30b] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:29.420460 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9285f964-0c69-46ac-8ae5-005cae34d781 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:29.420941 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9285f964-0c69-46ac-8ae5-005cae34d781 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:29.421374 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9285f964-0c69-46ac-8ae5-005cae34d781 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:29.422746 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9285f964-0c69-46ac-8ae5-005cae34d781 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:29.423208 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9285f964-0c69-46ac-8ae5-005cae34d781 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:29.423631 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9285f964-0c69-46ac-8ae5-005cae34d781 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:29.439313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-9285f964-0c69-46ac-8ae5-005cae34d781 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] HTTP exception thrown: Instance b63e70e7-b2ef-4b6e-9457-7f92d1adc30b could not be found. Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-9285f964-0c69-46ac-8ae5-005cae34d781 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Request method failure captured: Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b HTTP/1.1 Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhyTWk-O_OqLu_QeVTQLGezpCiVh9Jp0zHNg2lqfT0Png45XS8EJWyhymALQ_6L6XTxU4HFylmj21NenAQlCkR84qrUm5z1Lzuu7Dh1GHFETRqOJvY3lOx3YMLbR2dPAhbN8QKpf63w7T_Rznuj0YxzoXwF5Rmr0Z1LIXpdwGvvj_W0 Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: 566514b413e24aaebe69c11ce2159ac9 Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-TestVolumeBootPattern-383952907 Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:38:29.440994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:38:29.442662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_566514b413e24aaebe69c11ce2159ac9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/566514b413e24aaebe69c11ce2159ac9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/566514b413e24aaebe69c11ce2159ac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/566514b413e24aaebe69c11ce2159ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:38:29.442662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-TestVolumeBootPattern-383952907 Nov 02 07:38:29.442662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: 566514b413e24aaebe69c11ce2159ac9 Nov 02 07:38:29.442662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-TestVolumeBootPattern-383952907 Nov 02 07:38:29.442662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-TestVolumeBootPattern-383952907-project Nov 02 07:38:29.442662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:38:29.442662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:38:29.442662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: fe26aea6bb9d4dcebf046da719b2c244 Nov 02 07:38:29.442662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-TestVolumeBootPattern-383952907-project Nov 02 07:38:29.442662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:38:29.442662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance b63e70e7-b2ef-4b6e-9457-7f92d1adc30b could not be found. Nov 02 07:38:29.442662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': 'b63e70e7-b2ef-4b6e-9457-7f92d1adc30b'} Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b63e70e7-b2ef-4b6e-9457-7f92d1adc30b could not be found. Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:38:29.443591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b63e70e7-b2ef-4b6e-9457-7f92d1adc30b could not be found. Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b63e70e7-b2ef-4b6e-9457-7f92d1adc30b could not be found. Nov 02 07:38:29.445203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:38:29.448122 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-9285f964-0c69-46ac-8ae5-005cae34d781 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Returning 404 to user: Instance b63e70e7-b2ef-4b6e-9457-7f92d1adc30b could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:38:29.449437 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-9285f964-0c69-46ac-8ae5-005cae34d781 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b" status: 404 len: 111 microversion: 2.1 time: 0.042746 Nov 02 07:38:29.450574 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 468/935] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:29 2022] GET /compute/v2.1/servers/b63e70e7-b2ef-4b6e-9457-7f92d1adc30b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 07:38:29.841280 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-b80e4ea3-bc5b-4d2f-86f5-60d007937854 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:29.841899 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-b80e4ea3-bc5b-4d2f-86f5-60d007937854 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:29.849981 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b80e4ea3-bc5b-4d2f-86f5-60d007937854 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:29.850530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b80e4ea3-bc5b-4d2f-86f5-60d007937854 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:29.851354 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b80e4ea3-bc5b-4d2f-86f5-60d007937854 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:29.852064 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b80e4ea3-bc5b-4d2f-86f5-60d007937854 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:29.852514 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b80e4ea3-bc5b-4d2f-86f5-60d007937854 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:29.852934 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-b80e4ea3-bc5b-4d2f-86f5-60d007937854 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:29.924210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-b80e4ea3-bc5b-4d2f-86f5-60d007937854 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:29.932383 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-b80e4ea3-bc5b-4d2f-86f5-60d007937854 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560" status: 200 len: 1270 microversion: 2.1 time: 0.097603 Nov 02 07:38:29.932952 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 468/936] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:29 2022] GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:29.936491 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8588cf64-6cf2-4adb-b90b-abd50f986458 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:29.937193 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-8588cf64-6cf2-4adb-b90b-abd50f986458 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:29.944042 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8588cf64-6cf2-4adb-b90b-abd50f986458 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:29.944589 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8588cf64-6cf2-4adb-b90b-abd50f986458 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:29.945201 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8588cf64-6cf2-4adb-b90b-abd50f986458 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:29.945902 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8588cf64-6cf2-4adb-b90b-abd50f986458 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:29.946381 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8588cf64-6cf2-4adb-b90b-abd50f986458 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:29.946813 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-8588cf64-6cf2-4adb-b90b-abd50f986458 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:29.960729 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-8588cf64-6cf2-4adb-b90b-abd50f986458 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] HTTP exception thrown: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8588cf64-6cf2-4adb-b90b-abd50f986458 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Request method failure captured: Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: DELETE /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a HTTP/1.1 Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYhyTWk-O_OqLu_QeVTQLGezpCiVh9Jp0zHNg2lqfT0Png45XS8EJWyhymALQ_6L6XTxU4HFylmj21NenAQlCkR84qrUm5z1Lzuu7Dh1GHFETRqOJvY3lOx3YMLbR2dPAhbN8QKpf63w7T_Rznuj0YxzoXwF5Rmr0Z1LIXpdwGvvj_W0 Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: 566514b413e24aaebe69c11ce2159ac9 Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-TestVolumeBootPattern-383952907 Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:38:29.962307 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:38:29.963949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_566514b413e24aaebe69c11ce2159ac9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/566514b413e24aaebe69c11ce2159ac9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/566514b413e24aaebe69c11ce2159ac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/566514b413e24aaebe69c11ce2159ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:38:29.963949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-TestVolumeBootPattern-383952907 Nov 02 07:38:29.963949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: 566514b413e24aaebe69c11ce2159ac9 Nov 02 07:38:29.963949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-TestVolumeBootPattern-383952907 Nov 02 07:38:29.963949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-TestVolumeBootPattern-383952907-project Nov 02 07:38:29.963949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:38:29.963949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:38:29.963949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: fe26aea6bb9d4dcebf046da719b2c244 Nov 02 07:38:29.963949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-TestVolumeBootPattern-383952907-project Nov 02 07:38:29.963949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:38:29.963949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. Nov 02 07:38:29.963949 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': '4c89d505-bb4e-469f-bcb9-c336439e865a'} Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:38:29.964829 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. Nov 02 07:38:29.966289 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:38:29.967950 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-8588cf64-6cf2-4adb-b90b-abd50f986458 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Returning 404 to user: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:38:29.967950 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-8588cf64-6cf2-4adb-b90b-abd50f986458 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 404 len: 111 microversion: 2.1 time: 0.031388 Nov 02 07:38:29.967950 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 469/937] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:38:29 2022] DELETE /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:38:29.974629 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e9d6f508-0325-47fa-b9d2-6730c3cde9b8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:29.975245 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e9d6f508-0325-47fa-b9d2-6730c3cde9b8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [instance: 4c89d505-bb4e-469f-bcb9-c336439e865a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:29.981787 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e9d6f508-0325-47fa-b9d2-6730c3cde9b8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:29.982277 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e9d6f508-0325-47fa-b9d2-6730c3cde9b8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:29.982755 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e9d6f508-0325-47fa-b9d2-6730c3cde9b8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:29.983445 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e9d6f508-0325-47fa-b9d2-6730c3cde9b8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:29.983945 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e9d6f508-0325-47fa-b9d2-6730c3cde9b8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:29.984395 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e9d6f508-0325-47fa-b9d2-6730c3cde9b8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:29.999560 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-e9d6f508-0325-47fa-b9d2-6730c3cde9b8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] HTTP exception thrown: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e9d6f508-0325-47fa-b9d2-6730c3cde9b8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Request method failure captured: Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a HTTP/1.1 Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYhyTWk-O_OqLu_QeVTQLGezpCiVh9Jp0zHNg2lqfT0Png45XS8EJWyhymALQ_6L6XTxU4HFylmj21NenAQlCkR84qrUm5z1Lzuu7Dh1GHFETRqOJvY3lOx3YMLbR2dPAhbN8QKpf63w7T_Rznuj0YxzoXwF5Rmr0Z1LIXpdwGvvj_W0 Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: 566514b413e24aaebe69c11ce2159ac9 Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-TestVolumeBootPattern-383952907 Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:38:30.001276 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:38:30.002969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_566514b413e24aaebe69c11ce2159ac9", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/566514b413e24aaebe69c11ce2159ac9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/566514b413e24aaebe69c11ce2159ac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/566514b413e24aaebe69c11ce2159ac9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:38:30.002969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-TestVolumeBootPattern-383952907 Nov 02 07:38:30.002969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: 566514b413e24aaebe69c11ce2159ac9 Nov 02 07:38:30.002969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-TestVolumeBootPattern-383952907 Nov 02 07:38:30.002969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-TestVolumeBootPattern-383952907-project Nov 02 07:38:30.002969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:38:30.002969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:38:30.002969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: fe26aea6bb9d4dcebf046da719b2c244 Nov 02 07:38:30.002969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-TestVolumeBootPattern-383952907-project Nov 02 07:38:30.002969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:38:30.002969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. Nov 02 07:38:30.002969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '4c89d505-bb4e-469f-bcb9-c336439e865a'} Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:38:30.003761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. Nov 02 07:38:30.005063 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:38:30.006246 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e9d6f508-0325-47fa-b9d2-6730c3cde9b8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Returning 404 to user: Instance 4c89d505-bb4e-469f-bcb9-c336439e865a could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:38:30.006246 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e9d6f508-0325-47fa-b9d2-6730c3cde9b8 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a" status: 404 len: 111 microversion: 2.1 time: 0.032275 Nov 02 07:38:30.006246 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 469/938] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:29 2022] GET /compute/v2.1/servers/4c89d505-bb4e-469f-bcb9-c336439e865a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:38:30.956934 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-277b1e50-c2cc-4b24-8fdd-39dacc1da1c7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:30.957668 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-277b1e50-c2cc-4b24-8fdd-39dacc1da1c7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:30.964100 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-277b1e50-c2cc-4b24-8fdd-39dacc1da1c7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:30.964656 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-277b1e50-c2cc-4b24-8fdd-39dacc1da1c7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:30.965149 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-277b1e50-c2cc-4b24-8fdd-39dacc1da1c7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:30.965926 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-277b1e50-c2cc-4b24-8fdd-39dacc1da1c7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:30.966469 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-277b1e50-c2cc-4b24-8fdd-39dacc1da1c7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:30.966897 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-277b1e50-c2cc-4b24-8fdd-39dacc1da1c7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:31.177448 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-277b1e50-c2cc-4b24-8fdd-39dacc1da1c7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:31.185582 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-277b1e50-c2cc-4b24-8fdd-39dacc1da1c7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560" status: 200 len: 1318 microversion: 2.1 time: 0.233163 Nov 02 07:38:31.186849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 470/939] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:30 2022] GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:31.332718 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c168d930-0eda-47e2-9535-b205cbb331a2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] Calling method '.version_select at 0x7f4d6a22d040>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:31.338208 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c168d930-0eda-47e2-9535-b205cbb331a2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [3b7b2fe7-0fcb-42a4-bdf0-bc54bf4fa2a3] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 07:38:31.405398 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-d232334e-e684-4124-a0ac-77a0722b2031 req-dfab1c6d-14af-4323-9dc3-495af5eeea81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc3283b2-ed59-44f4-b90a-04df83443560", "tag": "fa1663f1-c844-458e-af96-4e8b2b70952f"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:38:31.420912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-d232334e-e684-4124-a0ac-77a0722b2031 req-dfab1c6d-14af-4323-9dc3-495af5eeea81 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:31.421310 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-d232334e-e684-4124-a0ac-77a0722b2031 req-dfab1c6d-14af-4323-9dc3-495af5eeea81 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:31.421741 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-d232334e-e684-4124-a0ac-77a0722b2031 req-dfab1c6d-14af-4323-9dc3-495af5eeea81 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:31.432999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-d232334e-e684-4124-a0ac-77a0722b2031 req-dfab1c6d-14af-4323-9dc3-495af5eeea81 service nova] Creating event network-changed:fa1663f1-c844-458e-af96-4e8b2b70952f for instance dc3283b2-ed59-44f4-b90a-04df83443560 on hv-cinder-80473 Nov 02 07:38:31.438397 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-d232334e-e684-4124-a0ac-77a0722b2031 req-dfab1c6d-14af-4323-9dc3-495af5eeea81 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036144 Nov 02 07:38:31.439300 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 471/940] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:38:32.211423 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c89acdf4-06e3-4778-8e1a-bcdd041629ee tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:32.212123 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c89acdf4-06e3-4778-8e1a-bcdd041629ee tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:32.218239 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c89acdf4-06e3-4778-8e1a-bcdd041629ee tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:32.218747 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c89acdf4-06e3-4778-8e1a-bcdd041629ee tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:32.219397 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c89acdf4-06e3-4778-8e1a-bcdd041629ee tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:32.220301 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c89acdf4-06e3-4778-8e1a-bcdd041629ee tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:32.220752 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c89acdf4-06e3-4778-8e1a-bcdd041629ee tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:32.221176 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c89acdf4-06e3-4778-8e1a-bcdd041629ee tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:32.347832 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c89acdf4-06e3-4778-8e1a-bcdd041629ee tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:32.348319 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO oslo.messaging._drivers.impl_rabbit [None req-c168d930-0eda-47e2-9535-b205cbb331a2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] [3b7b2fe7-0fcb-42a4-bdf0-bc54bf4fa2a3] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60412. Nov 02 07:38:32.355571 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c89acdf4-06e3-4778-8e1a-bcdd041629ee tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560" status: 200 len: 1318 microversion: 2.1 time: 0.148869 Nov 02 07:38:32.356134 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 472/941] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:32 2022] GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:38:32.368064 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c168d930-0eda-47e2-9535-b205cbb331a2 tempest-TestVolumeBootPattern-383952907 tempest-TestVolumeBootPattern-383952907-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-823697442" status: 202 len: 0 microversion: 2.1 time: 1.040410 Nov 02 07:38:32.368629 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 470/942] 10.222.0.18 () {58 vars in 1260 bytes} [Wed Nov 2 07:38:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-823697442 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:38:32.511458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-02dd4eb2-e686-427e-94ab-b8a80b3f58b9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-223621325"}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:38:32.512335 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-02dd4eb2-e686-427e-94ab-b8a80b3f58b9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:32.518902 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-02dd4eb2-e686-427e-94ab-b8a80b3f58b9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:32.519389 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-02dd4eb2-e686-427e-94ab-b8a80b3f58b9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:32.519827 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-02dd4eb2-e686-427e-94ab-b8a80b3f58b9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:32.520514 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-02dd4eb2-e686-427e-94ab-b8a80b3f58b9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:32.520969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-02dd4eb2-e686-427e-94ab-b8a80b3f58b9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:32.521394 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-02dd4eb2-e686-427e-94ab-b8a80b3f58b9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:32.766698 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.network.security_group_api [None req-02dd4eb2-e686-427e-94ab-b8a80b3f58b9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Removing security group 5955c213-20e0-4cb5-b4d4-acf9e40431f3 from port 33ad81f7-86a8-4d84-8799-f57ab596e5c4 Nov 02 07:38:33.379919 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f4269123-8ce9-4859-b9e1-86d057dd4e08 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:33.380539 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f4269123-8ce9-4859-b9e1-86d057dd4e08 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:33.387694 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f4269123-8ce9-4859-b9e1-86d057dd4e08 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:33.388181 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f4269123-8ce9-4859-b9e1-86d057dd4e08 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:33.388613 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f4269123-8ce9-4859-b9e1-86d057dd4e08 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:33.389308 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f4269123-8ce9-4859-b9e1-86d057dd4e08 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:33.389760 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f4269123-8ce9-4859-b9e1-86d057dd4e08 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:33.390182 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f4269123-8ce9-4859-b9e1-86d057dd4e08 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:33.748383 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-f4269123-8ce9-4859-b9e1-86d057dd4e08 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:33.756756 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f4269123-8ce9-4859-b9e1-86d057dd4e08 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560" status: 200 len: 1318 microversion: 2.1 time: 0.381469 Nov 02 07:38:33.757332 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 471/943] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:33 2022] GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:38:33.859448 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-02dd4eb2-e686-427e-94ab-b8a80b3f58b9 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "POST /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/action" status: 202 len: 0 microversion: 2.1 time: 1.351906 Nov 02 07:38:33.861188 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 473/944] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 07:38:32 2022] POST /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/action => generated 0 bytes in 1354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:38:33.871150 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-9f141713-4b83-4587-8d0c-be50d4f5367b req-155f4a2f-056c-4c9a-b04e-0d6c633a64e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8", "tag": "33ad81f7-86a8-4d84-8799-f57ab596e5c4"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:38:33.882258 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-9f141713-4b83-4587-8d0c-be50d4f5367b req-155f4a2f-056c-4c9a-b04e-0d6c633a64e0 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:33.884002 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-9f141713-4b83-4587-8d0c-be50d4f5367b req-155f4a2f-056c-4c9a-b04e-0d6c633a64e0 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:33.884642 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-9f141713-4b83-4587-8d0c-be50d4f5367b req-155f4a2f-056c-4c9a-b04e-0d6c633a64e0 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:33.900573 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-9f141713-4b83-4587-8d0c-be50d4f5367b req-155f4a2f-056c-4c9a-b04e-0d6c633a64e0 service nova] Creating event network-changed:33ad81f7-86a8-4d84-8799-f57ab596e5c4 for instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 on hv-cinder-80473 Nov 02 07:38:33.907980 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-9f141713-4b83-4587-8d0c-be50d4f5367b req-155f4a2f-056c-4c9a-b04e-0d6c633a64e0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039826 Nov 02 07:38:33.908924 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 472/945] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:38:34.782088 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f1bce890-20f9-408d-a6fc-363123b62370 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:34.783054 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f1bce890-20f9-408d-a6fc-363123b62370 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:34.789116 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f1bce890-20f9-408d-a6fc-363123b62370 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:34.789598 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f1bce890-20f9-408d-a6fc-363123b62370 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:34.790033 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f1bce890-20f9-408d-a6fc-363123b62370 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:34.790756 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f1bce890-20f9-408d-a6fc-363123b62370 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:34.791209 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f1bce890-20f9-408d-a6fc-363123b62370 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:34.791630 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f1bce890-20f9-408d-a6fc-363123b62370 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:35.178305 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-f1bce890-20f9-408d-a6fc-363123b62370 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:35.191541 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f1bce890-20f9-408d-a6fc-363123b62370 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560" status: 200 len: 1318 microversion: 2.1 time: 0.414081 Nov 02 07:38:35.195413 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 474/946] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:34 2022] GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:35.570399 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-977cc87a-8445-4114-9c92-29f360f2cc58 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:35.571084 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-977cc87a-8445-4114-9c92-29f360f2cc58 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:35.577493 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-75b7819b-fb68-4753-827e-546bc79e34db req-7683fa8d-64b9-45f7-abc1-7e232cf040b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8", "tag": "33ad81f7-86a8-4d84-8799-f57ab596e5c4"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:38:35.581748 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-977cc87a-8445-4114-9c92-29f360f2cc58 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:35.582476 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-977cc87a-8445-4114-9c92-29f360f2cc58 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:35.583123 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-977cc87a-8445-4114-9c92-29f360f2cc58 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:35.584019 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-977cc87a-8445-4114-9c92-29f360f2cc58 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:35.584838 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-977cc87a-8445-4114-9c92-29f360f2cc58 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:35.585423 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-977cc87a-8445-4114-9c92-29f360f2cc58 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:35.589043 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-75b7819b-fb68-4753-827e-546bc79e34db req-7683fa8d-64b9-45f7-abc1-7e232cf040b8 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:35.589779 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-75b7819b-fb68-4753-827e-546bc79e34db req-7683fa8d-64b9-45f7-abc1-7e232cf040b8 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:35.591950 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-75b7819b-fb68-4753-827e-546bc79e34db req-7683fa8d-64b9-45f7-abc1-7e232cf040b8 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:35.608420 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-75b7819b-fb68-4753-827e-546bc79e34db req-7683fa8d-64b9-45f7-abc1-7e232cf040b8 service nova] Creating event network-changed:33ad81f7-86a8-4d84-8799-f57ab596e5c4 for instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 on hv-cinder-80473 Nov 02 07:38:35.616544 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-75b7819b-fb68-4753-827e-546bc79e34db req-7683fa8d-64b9-45f7-abc1-7e232cf040b8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042669 Nov 02 07:38:35.621920 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 475/947] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:38:35.709465 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-977cc87a-8445-4114-9c92-29f360f2cc58 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lazy-loading 'services' on Instance uuid 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:38:35.836881 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-977cc87a-8445-4114-9c92-29f360f2cc58 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "DELETE /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/os-volume_attachments/ef3d7e3c-3b7c-4993-8504-ceab7baca67f" status: 202 len: 0 microversion: 2.1 time: 0.270927 Nov 02 07:38:35.851512 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-2a37f90b-40b8-4463-a7fb-dcd4f33a6817 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:35.855981 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 473/948] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 07:38:35 2022] DELETE /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/os-volume_attachments/ef3d7e3c-3b7c-4993-8504-ceab7baca67f => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:38:35.856260 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-2a37f90b-40b8-4463-a7fb-dcd4f33a6817 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:35.873175 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2a37f90b-40b8-4463-a7fb-dcd4f33a6817 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:35.874012 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2a37f90b-40b8-4463-a7fb-dcd4f33a6817 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:35.875233 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2a37f90b-40b8-4463-a7fb-dcd4f33a6817 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:35.877356 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2a37f90b-40b8-4463-a7fb-dcd4f33a6817 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:35.878013 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2a37f90b-40b8-4463-a7fb-dcd4f33a6817 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:35.878819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-2a37f90b-40b8-4463-a7fb-dcd4f33a6817 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:35.931198 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-2a37f90b-40b8-4463-a7fb-dcd4f33a6817 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087445 Nov 02 07:38:35.937591 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 476/949] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 07:38:35 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:38:36.217877 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-25adaa4e-3ebf-49ea-a96e-819fc93b49b4 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:36.218674 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-25adaa4e-3ebf-49ea-a96e-819fc93b49b4 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:36.231235 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-25adaa4e-3ebf-49ea-a96e-819fc93b49b4 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:36.234484 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-25adaa4e-3ebf-49ea-a96e-819fc93b49b4 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:36.235744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-25adaa4e-3ebf-49ea-a96e-819fc93b49b4 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:36.236646 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-25adaa4e-3ebf-49ea-a96e-819fc93b49b4 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:36.237288 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-25adaa4e-3ebf-49ea-a96e-819fc93b49b4 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:36.237678 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-25adaa4e-3ebf-49ea-a96e-819fc93b49b4 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:36.618160 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-25adaa4e-3ebf-49ea-a96e-819fc93b49b4 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:36.627984 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-25adaa4e-3ebf-49ea-a96e-819fc93b49b4 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560" status: 200 len: 1318 microversion: 2.1 time: 0.414372 Nov 02 07:38:36.643225 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 474/950] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:36 2022] GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:36.956157 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-71761651-8a8b-4c82-b38f-be5326540753 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:36.965994 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-71761651-8a8b-4c82-b38f-be5326540753 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:36.977439 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-71761651-8a8b-4c82-b38f-be5326540753 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:36.977931 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-71761651-8a8b-4c82-b38f-be5326540753 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:36.979017 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-71761651-8a8b-4c82-b38f-be5326540753 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:36.984673 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-71761651-8a8b-4c82-b38f-be5326540753 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:36.986267 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-71761651-8a8b-4c82-b38f-be5326540753 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:36.986968 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-71761651-8a8b-4c82-b38f-be5326540753 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:37.035341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-71761651-8a8b-4c82-b38f-be5326540753 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089992 Nov 02 07:38:37.036415 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 477/951] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 07:38:36 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 07:38:37.048752 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2150b346-c1c0-419e-942c-a31a1c17a8fc tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:37.049245 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-2150b346-c1c0-419e-942c-a31a1c17a8fc tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:37.056007 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2150b346-c1c0-419e-942c-a31a1c17a8fc tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:37.056822 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2150b346-c1c0-419e-942c-a31a1c17a8fc tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:37.057353 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2150b346-c1c0-419e-942c-a31a1c17a8fc tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:37.058627 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2150b346-c1c0-419e-942c-a31a1c17a8fc tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:37.059024 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2150b346-c1c0-419e-942c-a31a1c17a8fc tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:37.059413 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2150b346-c1c0-419e-942c-a31a1c17a8fc tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:37.160187 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-2150b346-c1c0-419e-942c-a31a1c17a8fc tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] HTTP exception thrown: Instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 is not attached to volume ef3d7e3c-3b7c-4993-8504-ceab7baca67f Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2150b346-c1c0-419e-942c-a31a1c17a8fc tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Request method failure captured: Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: DELETE /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/os-volume_attachments/ef3d7e3c-3b7c-4993-8504-ceab7baca67f HTTP/1.1 Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYh3im7SfVrMkzxvTJGXGweppvwtouig2f97ywq_2wNNujaR9e-Ia-jZY_P7detrKHMYFUGD5eLxEqyASZnrdd7XtYJM-eL28FYx8p_WmqzFUnH3OTlMI1zzKTC9-RKUzv-26RCHC5t6YBNm5oLQY9L9wEoGhosVHEubXrQOgA46UlPE Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: 280ce4c6b9174073902820e2e922bedf Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-TestMinimumBasicScenario-2022115752 Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:38:37.163051 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:38:37.164641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_280ce4c6b9174073902820e2e922bedf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/280ce4c6b9174073902820e2e922bedf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/280ce4c6b9174073902820e2e922bedf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/280ce4c6b9174073902820e2e922bedf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:38:37.164641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-TestMinimumBasicScenario-2022115752 Nov 02 07:38:37.164641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: 280ce4c6b9174073902820e2e922bedf Nov 02 07:38:37.164641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2022115752 Nov 02 07:38:37.164641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-TestMinimumBasicScenario-2022115752-project Nov 02 07:38:37.164641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:38:37.164641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:38:37.164641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: b0d0493e92b746eabdd4cb0912fa250c Nov 02 07:38:37.164641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-TestMinimumBasicScenario-2022115752-project Nov 02 07:38:37.164641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:38:37.164641 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 is not attached to volume ef3d7e3c-3b7c-4993-8504-ceab7baca67f Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'server_id': '72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8', 'id': 'ef3d7e3c-3b7c-4993-8504-ceab7baca67f'} Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ef3d7e3c-3b7c-4993-8504-ceab7baca67f. Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:38:37.165502 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:38:37.167115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:38:37.167115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 07:38:37.167115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 07:38:37.167115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 is not attached to volume ef3d7e3c-3b7c-4993-8504-ceab7baca67f Nov 02 07:38:37.167115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:38:37.167115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:38:37.167115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:38:37.167115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:37.167115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:38:37.167115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:38:37.167115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:38:37.167115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:38:37.167115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 is not attached to volume ef3d7e3c-3b7c-4993-8504-ceab7baca67f Nov 02 07:38:37.167115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:38:37.170047 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2150b346-c1c0-419e-942c-a31a1c17a8fc tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Returning 404 to user: Instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 is not attached to volume ef3d7e3c-3b7c-4993-8504-ceab7baca67f {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:38:37.171210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-2150b346-c1c0-419e-942c-a31a1c17a8fc tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "DELETE /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/os-volume_attachments/ef3d7e3c-3b7c-4993-8504-ceab7baca67f" status: 404 len: 154 microversion: 2.1 time: 0.127738 Nov 02 07:38:37.176310 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 475/952] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 07:38:37 2022] DELETE /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8/os-volume_attachments/ef3d7e3c-3b7c-4993-8504-ceab7baca67f => generated 154 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:38:37.341216 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-90a35784-1390-49ad-8685-dd82dd579dab req-617ddf2c-3ffa-4802-b7ec-953658389c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3283b2-ed59-44f4-b90a-04df83443560", "name": "network-vif-plugged", "status": "completed", "tag": "fa1663f1-c844-458e-af96-4e8b2b70952f"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:38:37.351282 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-90a35784-1390-49ad-8685-dd82dd579dab req-617ddf2c-3ffa-4802-b7ec-953658389c98 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:37.351945 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-90a35784-1390-49ad-8685-dd82dd579dab req-617ddf2c-3ffa-4802-b7ec-953658389c98 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:37.352527 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-90a35784-1390-49ad-8685-dd82dd579dab req-617ddf2c-3ffa-4802-b7ec-953658389c98 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:37.365132 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-90a35784-1390-49ad-8685-dd82dd579dab req-617ddf2c-3ffa-4802-b7ec-953658389c98 service nova] Creating event network-vif-plugged:fa1663f1-c844-458e-af96-4e8b2b70952f for instance dc3283b2-ed59-44f4-b90a-04df83443560 on hv-cinder-80473 Nov 02 07:38:37.370208 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-90a35784-1390-49ad-8685-dd82dd579dab req-617ddf2c-3ffa-4802-b7ec-953658389c98 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032605 Nov 02 07:38:37.371121 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 478/953] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:38:37.653305 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-938895a7-aaea-4932-8bf7-553b4f6c9d0b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:37.654146 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-938895a7-aaea-4932-8bf7-553b4f6c9d0b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:37.662064 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-938895a7-aaea-4932-8bf7-553b4f6c9d0b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:37.662783 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-938895a7-aaea-4932-8bf7-553b4f6c9d0b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:37.663417 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-938895a7-aaea-4932-8bf7-553b4f6c9d0b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:37.664181 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-938895a7-aaea-4932-8bf7-553b4f6c9d0b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:37.664807 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-938895a7-aaea-4932-8bf7-553b4f6c9d0b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:37.665296 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-938895a7-aaea-4932-8bf7-553b4f6c9d0b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:37.884227 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-938895a7-aaea-4932-8bf7-553b4f6c9d0b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:37.893108 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-938895a7-aaea-4932-8bf7-553b4f6c9d0b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560" status: 200 len: 1318 microversion: 2.1 time: 0.243764 Nov 02 07:38:37.893960 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 476/954] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:37 2022] GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:38.367133 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-167b267a-2cfd-4dd8-9d68-42997db31de7 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:38.367710 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-167b267a-2cfd-4dd8-9d68-42997db31de7 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:38.373860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-167b267a-2cfd-4dd8-9d68-42997db31de7 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:38.374343 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-167b267a-2cfd-4dd8-9d68-42997db31de7 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:38.374822 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-167b267a-2cfd-4dd8-9d68-42997db31de7 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:38.375551 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-167b267a-2cfd-4dd8-9d68-42997db31de7 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:38.376008 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-167b267a-2cfd-4dd8-9d68-42997db31de7 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:38.376516 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-167b267a-2cfd-4dd8-9d68-42997db31de7 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:38.403480 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-167b267a-2cfd-4dd8-9d68-42997db31de7 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Going to try to terminate instance {{(pid=118991) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:38:38.481276 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-167b267a-2cfd-4dd8-9d68-42997db31de7 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "DELETE /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 204 len: 0 microversion: 2.1 time: 0.118427 Nov 02 07:38:38.482168 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 479/955] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:38:38 2022] DELETE /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:38:38.491354 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-477ae793-845b-45bf-8e62-2e879cd96b76 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:38.492740 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-477ae793-845b-45bf-8e62-2e879cd96b76 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:38.500388 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-477ae793-845b-45bf-8e62-2e879cd96b76 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:38.501614 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-477ae793-845b-45bf-8e62-2e879cd96b76 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:38.502121 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-477ae793-845b-45bf-8e62-2e879cd96b76 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:38.502933 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-477ae793-845b-45bf-8e62-2e879cd96b76 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:38.503453 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-477ae793-845b-45bf-8e62-2e879cd96b76 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:38.503969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-477ae793-845b-45bf-8e62-2e879cd96b76 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:38.716323 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-477ae793-845b-45bf-8e62-2e879cd96b76 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:38.725197 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-477ae793-845b-45bf-8e62-2e879cd96b76 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1554 microversion: 2.1 time: 0.237682 Nov 02 07:38:38.725769 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 477/956] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:38 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:38:38.919420 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-9fef86b5-56aa-41db-a7d5-f033a087aa98 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:38.920230 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-9fef86b5-56aa-41db-a7d5-f033a087aa98 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:38.926016 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:38.927387 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=6 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:38.933614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9fef86b5-56aa-41db-a7d5-f033a087aa98 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:38.934770 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9fef86b5-56aa-41db-a7d5-f033a087aa98 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:38.935174 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9fef86b5-56aa-41db-a7d5-f033a087aa98 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:38.935863 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9fef86b5-56aa-41db-a7d5-f033a087aa98 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:38.936317 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9fef86b5-56aa-41db-a7d5-f033a087aa98 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:38.936759 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9fef86b5-56aa-41db-a7d5-f033a087aa98 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:39.156241 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-9fef86b5-56aa-41db-a7d5-f033a087aa98 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:39.164724 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-9fef86b5-56aa-41db-a7d5-f033a087aa98 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560" status: 200 len: 1318 microversion: 2.1 time: 0.251185 Nov 02 07:38:39.165298 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 480/957] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:38 2022] GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:39.749089 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-fc138da1-5ecd-43ad-8b8e-756fecc57e44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:39.749871 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-fc138da1-5ecd-43ad-8b8e-756fecc57e44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:39.752848 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:39.761807 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc138da1-5ecd-43ad-8b8e-756fecc57e44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:39.762737 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc138da1-5ecd-43ad-8b8e-756fecc57e44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:39.763292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc138da1-5ecd-43ad-8b8e-756fecc57e44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:39.764088 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc138da1-5ecd-43ad-8b8e-756fecc57e44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:39.765002 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc138da1-5ecd-43ad-8b8e-756fecc57e44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:39.765667 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-fc138da1-5ecd-43ad-8b8e-756fecc57e44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:39.978181 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-fc138da1-5ecd-43ad-8b8e-756fecc57e44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:39.987544 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-fc138da1-5ecd-43ad-8b8e-756fecc57e44 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1554 microversion: 2.1 time: 0.242302 Nov 02 07:38:39.988120 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 478/958] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:39 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1554 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:40.188969 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-24bd4bb9-a008-4a25-a898-3fa69aa80739 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:40.189586 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-24bd4bb9-a008-4a25-a898-3fa69aa80739 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:40.199240 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24bd4bb9-a008-4a25-a898-3fa69aa80739 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:40.199734 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24bd4bb9-a008-4a25-a898-3fa69aa80739 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:40.200175 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24bd4bb9-a008-4a25-a898-3fa69aa80739 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:40.200883 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24bd4bb9-a008-4a25-a898-3fa69aa80739 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:40.201517 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24bd4bb9-a008-4a25-a898-3fa69aa80739 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:40.201924 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-24bd4bb9-a008-4a25-a898-3fa69aa80739 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:40.400422 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-24bd4bb9-a008-4a25-a898-3fa69aa80739 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:40.410498 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-24bd4bb9-a008-4a25-a898-3fa69aa80739 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560" status: 200 len: 1318 microversion: 2.1 time: 0.225954 Nov 02 07:38:40.423433 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 481/959] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:40 2022] GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:41.011677 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e024b09a-7415-40fb-b70d-ba06cb2fbb99 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:41.012772 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e024b09a-7415-40fb-b70d-ba06cb2fbb99 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:41.020766 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e024b09a-7415-40fb-b70d-ba06cb2fbb99 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:41.021255 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e024b09a-7415-40fb-b70d-ba06cb2fbb99 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:41.021685 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e024b09a-7415-40fb-b70d-ba06cb2fbb99 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:41.022514 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e024b09a-7415-40fb-b70d-ba06cb2fbb99 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:41.023111 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e024b09a-7415-40fb-b70d-ba06cb2fbb99 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:41.023518 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e024b09a-7415-40fb-b70d-ba06cb2fbb99 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:41.027839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:41.442140 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-6052d17e-c0ff-478e-b1a6-fcb361272f96 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:41.443677 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-6052d17e-c0ff-478e-b1a6-fcb361272f96 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:41.450998 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6052d17e-c0ff-478e-b1a6-fcb361272f96 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:41.452230 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6052d17e-c0ff-478e-b1a6-fcb361272f96 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:41.452943 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6052d17e-c0ff-478e-b1a6-fcb361272f96 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:41.454562 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6052d17e-c0ff-478e-b1a6-fcb361272f96 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:41.456962 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6052d17e-c0ff-478e-b1a6-fcb361272f96 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:41.459984 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6052d17e-c0ff-478e-b1a6-fcb361272f96 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:41.701703 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-e024b09a-7415-40fb-b70d-ba06cb2fbb99 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d0493e92b746eabdd4cb0912fa250c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280ce4c6b9174073902820e2e922bedf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:41.713190 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e024b09a-7415-40fb-b70d-ba06cb2fbb99 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 200 len: 1554 microversion: 2.1 time: 0.705296 Nov 02 07:38:41.727026 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 479/960] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:41 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 1554 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:41.771615 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-6052d17e-c0ff-478e-b1a6-fcb361272f96 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:41.780069 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-6052d17e-c0ff-478e-b1a6-fcb361272f96 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560" status: 200 len: 1507 microversion: 2.1 time: 0.348141 Nov 02 07:38:41.782429 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 482/961] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:41 2022] GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:41.974152 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-0529b95b-1c40-4918-a016-99fa1afbe709 req-ad044a4f-e94a-45f3-aebd-e0871383dcdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8", "name": "network-vif-deleted", "tag": "33ad81f7-86a8-4d84-8799-f57ab596e5c4"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:38:41.987679 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-0529b95b-1c40-4918-a016-99fa1afbe709 req-ad044a4f-e94a-45f3-aebd-e0871383dcdc service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:41.988482 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-0529b95b-1c40-4918-a016-99fa1afbe709 req-ad044a4f-e94a-45f3-aebd-e0871383dcdc service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:41.989132 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-0529b95b-1c40-4918-a016-99fa1afbe709 req-ad044a4f-e94a-45f3-aebd-e0871383dcdc service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:42.016083 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-0529b95b-1c40-4918-a016-99fa1afbe709 req-ad044a4f-e94a-45f3-aebd-e0871383dcdc service nova] Creating event network-vif-deleted:33ad81f7-86a8-4d84-8799-f57ab596e5c4 for instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 on hv-cinder-80473 Nov 02 07:38:42.022969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-0529b95b-1c40-4918-a016-99fa1afbe709 req-ad044a4f-e94a-45f3-aebd-e0871383dcdc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052582 Nov 02 07:38:42.027087 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 480/962] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:38:42.741252 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-6ab89627-89e0-4086-9ae8-1284744c2b06 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:42.741912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-6ab89627-89e0-4086-9ae8-1284744c2b06 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] [instance: 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:42.749883 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6ab89627-89e0-4086-9ae8-1284744c2b06 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:42.751140 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6ab89627-89e0-4086-9ae8-1284744c2b06 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:42.752046 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6ab89627-89e0-4086-9ae8-1284744c2b06 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:42.753769 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6ab89627-89e0-4086-9ae8-1284744c2b06 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:42.754260 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6ab89627-89e0-4086-9ae8-1284744c2b06 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:42.755027 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-6ab89627-89e0-4086-9ae8-1284744c2b06 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:42.772724 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-6ab89627-89e0-4086-9ae8-1284744c2b06 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] HTTP exception thrown: Instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 could not be found. Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-6ab89627-89e0-4086-9ae8-1284744c2b06 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Request method failure captured: Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 HTTP/1.1 Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYh3im7SfVrMkzxvTJGXGweppvwtouig2f97ywq_2wNNujaR9e-Ia-jZY_P7detrKHMYFUGD5eLxEqyASZnrdd7XtYJM-eL28FYx8p_WmqzFUnH3OTlMI1zzKTC9-RKUzv-26RCHC5t6YBNm5oLQY9L9wEoGhosVHEubXrQOgA46UlPE Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: 280ce4c6b9174073902820e2e922bedf Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-TestMinimumBasicScenario-2022115752 Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:38:42.774425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:38:42.775970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_280ce4c6b9174073902820e2e922bedf", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/280ce4c6b9174073902820e2e922bedf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/280ce4c6b9174073902820e2e922bedf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/280ce4c6b9174073902820e2e922bedf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:38:42.775970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-TestMinimumBasicScenario-2022115752 Nov 02 07:38:42.775970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: 280ce4c6b9174073902820e2e922bedf Nov 02 07:38:42.775970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2022115752 Nov 02 07:38:42.775970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-TestMinimumBasicScenario-2022115752-project Nov 02 07:38:42.775970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:38:42.775970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:38:42.775970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: b0d0493e92b746eabdd4cb0912fa250c Nov 02 07:38:42.775970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-TestMinimumBasicScenario-2022115752-project Nov 02 07:38:42.775970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:38:42.775970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 could not be found. Nov 02 07:38:42.775970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': '72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8'} Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 could not be found. Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:38:42.776847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 could not be found. Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 could not be found. Nov 02 07:38:42.778321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:38:42.781090 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-6ab89627-89e0-4086-9ae8-1284744c2b06 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Returning 404 to user: Instance 72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:38:42.781975 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-6ab89627-89e0-4086-9ae8-1284744c2b06 tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8" status: 404 len: 111 microversion: 2.1 time: 0.047273 Nov 02 07:38:42.782891 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 483/963] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:42 2022] GET /compute/v2.1/servers/72f7cfc8-c8d1-4f9a-8ead-75cfce02eae8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:38:42.792377 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f1fc67e8-ca6b-4d04-81a7-a90f3e5bc10a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] Calling method '.version_select at 0x7f4d6a1160d0>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:42.817487 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f1fc67e8-ca6b-4d04-81a7-a90f3e5bc10a tempest-TestMinimumBasicScenario-2022115752 tempest-TestMinimumBasicScenario-2022115752-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-326555685" status: 202 len: 0 microversion: 2.1 time: 0.029548 Nov 02 07:38:42.818178 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 481/964] 10.222.0.18 () {58 vars in 1269 bytes} [Wed Nov 2 07:38:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-326555685 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:38:46.820781 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-49bbbf68-dfe2-46ed-95af-c62914353899 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:46.821327 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-49bbbf68-dfe2-46ed-95af-c62914353899 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:46.828158 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-49bbbf68-dfe2-46ed-95af-c62914353899 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:46.828771 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-49bbbf68-dfe2-46ed-95af-c62914353899 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:46.829568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-49bbbf68-dfe2-46ed-95af-c62914353899 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:46.830173 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-49bbbf68-dfe2-46ed-95af-c62914353899 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:46.830648 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-49bbbf68-dfe2-46ed-95af-c62914353899 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:46.831067 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-49bbbf68-dfe2-46ed-95af-c62914353899 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:46.918965 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.objects.instance [None req-49bbbf68-dfe2-46ed-95af-c62914353899 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lazy-loading 'services' on Instance uuid 954fa08b-6370-4f1b-955f-d3c2efe8ba34 {{(pid=118991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:38:47.026721 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-49bbbf68-dfe2-46ed-95af-c62914353899 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "DELETE /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/os-volume_attachments/e69b04ea-75b4-48f0-a710-5eb49637f642" status: 202 len: 0 microversion: 2.1 time: 0.210213 Nov 02 07:38:47.027311 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 484/965] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 07:38:46 2022] DELETE /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/os-volume_attachments/e69b04ea-75b4-48f0-a710-5eb49637f642 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:38:48.183113 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7e4dbba7-4ae0-442f-8274-a09a45f78f1f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:38:48.191377 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7e4dbba7-4ae0-442f-8274-a09a45f78f1f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:48.192089 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7e4dbba7-4ae0-442f-8274-a09a45f78f1f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:48.192704 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7e4dbba7-4ae0-442f-8274-a09a45f78f1f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:48.217573 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-7e4dbba7-4ae0-442f-8274-a09a45f78f1f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Going to try to stop instance {{(pid=118992) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 07:38:48.266096 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-7e4dbba7-4ae0-442f-8274-a09a45f78f1f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "POST /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/action" status: 202 len: 0 microversion: 2.1 time: 0.087243 Nov 02 07:38:48.267669 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 482/966] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 07:38:48 2022] POST /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:38:48.279208 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-497bdc54-c879-40bb-bfc9-945ef3fc0397 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:48.280764 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-497bdc54-c879-40bb-bfc9-945ef3fc0397 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:48.289295 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-497bdc54-c879-40bb-bfc9-945ef3fc0397 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:48.290134 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-497bdc54-c879-40bb-bfc9-945ef3fc0397 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:48.290884 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-497bdc54-c879-40bb-bfc9-945ef3fc0397 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:48.291674 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-497bdc54-c879-40bb-bfc9-945ef3fc0397 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:48.292340 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-497bdc54-c879-40bb-bfc9-945ef3fc0397 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:48.292863 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-497bdc54-c879-40bb-bfc9-945ef3fc0397 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:48.309369 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:48.481539 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-497bdc54-c879-40bb-bfc9-945ef3fc0397 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:48.490887 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-497bdc54-c879-40bb-bfc9-945ef3fc0397 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1675 microversion: 2.1 time: 0.217110 Nov 02 07:38:48.491701 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 485/967] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:48 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1675 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:49.519150 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-42795a75-d055-44d8-bb12-54c0142612fe tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:49.520496 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-42795a75-d055-44d8-bb12-54c0142612fe tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:49.522919 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:49.529068 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-42795a75-d055-44d8-bb12-54c0142612fe tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:49.529668 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-42795a75-d055-44d8-bb12-54c0142612fe tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:49.530155 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-42795a75-d055-44d8-bb12-54c0142612fe tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:49.531065 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-42795a75-d055-44d8-bb12-54c0142612fe tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:49.531514 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-42795a75-d055-44d8-bb12-54c0142612fe tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:49.532496 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-42795a75-d055-44d8-bb12-54c0142612fe tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:49.701684 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-42795a75-d055-44d8-bb12-54c0142612fe tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:49.710851 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-42795a75-d055-44d8-bb12-54c0142612fe tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1675 microversion: 2.1 time: 0.198400 Nov 02 07:38:49.711543 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 483/968] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:49 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1675 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:50.738431 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-9dce2780-0ace-4996-b75c-2a6dac2a04ff tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:50.739175 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-9dce2780-0ace-4996-b75c-2a6dac2a04ff tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:50.741723 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:50.747054 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9dce2780-0ace-4996-b75c-2a6dac2a04ff tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:50.747537 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9dce2780-0ace-4996-b75c-2a6dac2a04ff tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:50.747970 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9dce2780-0ace-4996-b75c-2a6dac2a04ff tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:50.748661 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9dce2780-0ace-4996-b75c-2a6dac2a04ff tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:50.749112 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9dce2780-0ace-4996-b75c-2a6dac2a04ff tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:50.749539 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9dce2780-0ace-4996-b75c-2a6dac2a04ff tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:50.894505 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-9dce2780-0ace-4996-b75c-2a6dac2a04ff tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:50.903038 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-9dce2780-0ace-4996-b75c-2a6dac2a04ff tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1675 microversion: 2.1 time: 0.168810 Nov 02 07:38:50.903622 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 486/969] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:50 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:51.929579 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9a85a7ed-4330-45c3-ad72-34585b8d322a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:51.930274 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9a85a7ed-4330-45c3-ad72-34585b8d322a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:51.936755 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9a85a7ed-4330-45c3-ad72-34585b8d322a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:51.937237 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9a85a7ed-4330-45c3-ad72-34585b8d322a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:51.937671 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9a85a7ed-4330-45c3-ad72-34585b8d322a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:51.939161 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9a85a7ed-4330-45c3-ad72-34585b8d322a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:51.939627 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9a85a7ed-4330-45c3-ad72-34585b8d322a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:51.940053 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9a85a7ed-4330-45c3-ad72-34585b8d322a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:52.069863 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9a85a7ed-4330-45c3-ad72-34585b8d322a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:52.077762 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9a85a7ed-4330-45c3-ad72-34585b8d322a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1675 microversion: 2.1 time: 0.152012 Nov 02 07:38:52.078327 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 484/970] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:51 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:53.100691 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-ffdfb134-6c1d-4d17-b9ae-de749f23733c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:53.101347 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-ffdfb134-6c1d-4d17-b9ae-de749f23733c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:53.107777 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ffdfb134-6c1d-4d17-b9ae-de749f23733c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:53.108252 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ffdfb134-6c1d-4d17-b9ae-de749f23733c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:53.108776 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ffdfb134-6c1d-4d17-b9ae-de749f23733c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:53.109464 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ffdfb134-6c1d-4d17-b9ae-de749f23733c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:53.109908 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ffdfb134-6c1d-4d17-b9ae-de749f23733c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:53.110324 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-ffdfb134-6c1d-4d17-b9ae-de749f23733c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:53.240401 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-ffdfb134-6c1d-4d17-b9ae-de749f23733c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:53.248256 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-ffdfb134-6c1d-4d17-b9ae-de749f23733c tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1675 microversion: 2.1 time: 0.151445 Nov 02 07:38:53.248814 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 487/971] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:53 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:54.272196 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-714f5d5d-2c13-4a79-8479-e6ff8ae87d35 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:54.272833 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-714f5d5d-2c13-4a79-8479-e6ff8ae87d35 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:54.279374 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-714f5d5d-2c13-4a79-8479-e6ff8ae87d35 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:54.279852 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-714f5d5d-2c13-4a79-8479-e6ff8ae87d35 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:54.280283 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-714f5d5d-2c13-4a79-8479-e6ff8ae87d35 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:54.280959 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-714f5d5d-2c13-4a79-8479-e6ff8ae87d35 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:54.281406 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-714f5d5d-2c13-4a79-8479-e6ff8ae87d35 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:54.281825 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-714f5d5d-2c13-4a79-8479-e6ff8ae87d35 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:54.408962 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-714f5d5d-2c13-4a79-8479-e6ff8ae87d35 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:54.416585 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-714f5d5d-2c13-4a79-8479-e6ff8ae87d35 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1675 microversion: 2.1 time: 0.148269 Nov 02 07:38:54.417135 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 485/972] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:54 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:55.440906 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-838fa7b4-6af8-4ab7-84a9-70985583b3ca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:55.441521 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-838fa7b4-6af8-4ab7-84a9-70985583b3ca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:55.447985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-838fa7b4-6af8-4ab7-84a9-70985583b3ca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:55.448459 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-838fa7b4-6af8-4ab7-84a9-70985583b3ca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:55.448887 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-838fa7b4-6af8-4ab7-84a9-70985583b3ca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:55.449566 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-838fa7b4-6af8-4ab7-84a9-70985583b3ca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:55.450013 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-838fa7b4-6af8-4ab7-84a9-70985583b3ca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:55.450455 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-838fa7b4-6af8-4ab7-84a9-70985583b3ca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:55.584236 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-838fa7b4-6af8-4ab7-84a9-70985583b3ca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:55.591918 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-838fa7b4-6af8-4ab7-84a9-70985583b3ca tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1675 microversion: 2.1 time: 0.155547 Nov 02 07:38:55.592469 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 488/973] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:55 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:56.615219 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9c9593e8-d107-47ab-b5b9-251f278c1bf2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:56.615827 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9c9593e8-d107-47ab-b5b9-251f278c1bf2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:56.622256 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9c9593e8-d107-47ab-b5b9-251f278c1bf2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:56.622764 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9c9593e8-d107-47ab-b5b9-251f278c1bf2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:56.623193 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9c9593e8-d107-47ab-b5b9-251f278c1bf2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:56.623880 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9c9593e8-d107-47ab-b5b9-251f278c1bf2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:56.624329 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9c9593e8-d107-47ab-b5b9-251f278c1bf2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:56.624747 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9c9593e8-d107-47ab-b5b9-251f278c1bf2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:56.754553 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9c9593e8-d107-47ab-b5b9-251f278c1bf2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:56.762191 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9c9593e8-d107-47ab-b5b9-251f278c1bf2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1675 microversion: 2.1 time: 0.150978 Nov 02 07:38:56.763087 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 486/974] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:56 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:57.215874 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-cbe6673b-7c23-466e-b9cf-fde72d3deb1d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95e55334-07d1-420b-930a-1506af471415", "device": "/dev/sdb"}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:38:57.218834 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-cbe6673b-7c23-466e-b9cf-fde72d3deb1d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:57.225381 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cbe6673b-7c23-466e-b9cf-fde72d3deb1d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:57.225863 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cbe6673b-7c23-466e-b9cf-fde72d3deb1d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:57.226292 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cbe6673b-7c23-466e-b9cf-fde72d3deb1d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:57.227002 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cbe6673b-7c23-466e-b9cf-fde72d3deb1d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:57.227451 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cbe6673b-7c23-466e-b9cf-fde72d3deb1d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:57.227870 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cbe6673b-7c23-466e-b9cf-fde72d3deb1d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:57.483136 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-cbe6673b-7c23-466e-b9cf-fde72d3deb1d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "POST /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270757 Nov 02 07:38:57.483920 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 489/975] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 07:38:57 2022] POST /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:38:57.785731 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-5c63cd3b-d224-433a-b461-ce1506bb890e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:57.786341 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-5c63cd3b-d224-433a-b461-ce1506bb890e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:57.792703 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5c63cd3b-d224-433a-b461-ce1506bb890e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:57.793190 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5c63cd3b-d224-433a-b461-ce1506bb890e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:57.793625 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5c63cd3b-d224-433a-b461-ce1506bb890e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:57.794314 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5c63cd3b-d224-433a-b461-ce1506bb890e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:57.794795 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5c63cd3b-d224-433a-b461-ce1506bb890e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:57.795219 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-5c63cd3b-d224-433a-b461-ce1506bb890e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:57.930612 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-5c63cd3b-d224-433a-b461-ce1506bb890e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:57.938247 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-5c63cd3b-d224-433a-b461-ce1506bb890e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1675 microversion: 2.1 time: 0.156439 Nov 02 07:38:57.939525 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 487/976] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:57 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:38:58.962459 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-1565b45a-ef3a-459b-a46e-3526c17e1a44 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:58.963187 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-1565b45a-ef3a-459b-a46e-3526c17e1a44 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:58.969330 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1565b45a-ef3a-459b-a46e-3526c17e1a44 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:58.969849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1565b45a-ef3a-459b-a46e-3526c17e1a44 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:58.970290 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1565b45a-ef3a-459b-a46e-3526c17e1a44 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:58.970997 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1565b45a-ef3a-459b-a46e-3526c17e1a44 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:58.971452 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1565b45a-ef3a-459b-a46e-3526c17e1a44 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:58.971877 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1565b45a-ef3a-459b-a46e-3526c17e1a44 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:59.102981 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-1565b45a-ef3a-459b-a46e-3526c17e1a44 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:59.110682 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-1565b45a-ef3a-459b-a46e-3526c17e1a44 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1652 microversion: 2.1 time: 0.152966 Nov 02 07:38:59.111237 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 490/977] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:58 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1652 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:38:59.133931 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f9f4f2ae-2b3f-4d5b-9070-7dc2074737be tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:38:59.140745 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9f4f2ae-2b3f-4d5b-9070-7dc2074737be tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:59.141230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9f4f2ae-2b3f-4d5b-9070-7dc2074737be tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:59.142928 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f9f4f2ae-2b3f-4d5b-9070-7dc2074737be tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:59.167837 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f9f4f2ae-2b3f-4d5b-9070-7dc2074737be tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Going to try to start instance {{(pid=118992) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 07:38:59.213515 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f9f4f2ae-2b3f-4d5b-9070-7dc2074737be tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "POST /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/action" status: 202 len: 0 microversion: 2.1 time: 0.083175 Nov 02 07:38:59.214106 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 488/978] 10.222.0.18 () {60 vars in 1278 bytes} [Wed Nov 2 07:38:59 2022] POST /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:38:59.222423 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-e17fbe4c-57f0-4f7b-8343-6813d3e56a09 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:38:59.223033 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-e17fbe4c-57f0-4f7b-8343-6813d3e56a09 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:38:59.228847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e17fbe4c-57f0-4f7b-8343-6813d3e56a09 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:59.229333 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e17fbe4c-57f0-4f7b-8343-6813d3e56a09 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:59.229754 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e17fbe4c-57f0-4f7b-8343-6813d3e56a09 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:59.230469 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e17fbe4c-57f0-4f7b-8343-6813d3e56a09 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:38:59.230918 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e17fbe4c-57f0-4f7b-8343-6813d3e56a09 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:38:59.231343 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e17fbe4c-57f0-4f7b-8343-6813d3e56a09 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:38:59.395706 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e17fbe4c-57f0-4f7b-8343-6813d3e56a09 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:38:59.403548 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e17fbe4c-57f0-4f7b-8343-6813d3e56a09 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1661 microversion: 2.1 time: 0.185167 Nov 02 07:38:59.404122 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 491/979] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:38:59 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1661 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:00.428314 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-76ebb35f-1b70-485b-ac67-ed0c70763ce7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:00.428951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-76ebb35f-1b70-485b-ac67-ed0c70763ce7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:00.435091 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76ebb35f-1b70-485b-ac67-ed0c70763ce7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:00.435564 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76ebb35f-1b70-485b-ac67-ed0c70763ce7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:00.435989 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76ebb35f-1b70-485b-ac67-ed0c70763ce7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:00.436668 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76ebb35f-1b70-485b-ac67-ed0c70763ce7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:00.437115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76ebb35f-1b70-485b-ac67-ed0c70763ce7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:00.437536 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76ebb35f-1b70-485b-ac67-ed0c70763ce7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:00.569001 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-76ebb35f-1b70-485b-ac67-ed0c70763ce7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:00.576615 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-76ebb35f-1b70-485b-ac67-ed0c70763ce7 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1661 microversion: 2.1 time: 0.153753 Nov 02 07:39:00.577169 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 489/980] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:00 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1661 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:01.599868 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-98b4ac39-6b12-4fc5-b5cc-5b501945a00e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:01.600483 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-98b4ac39-6b12-4fc5-b5cc-5b501945a00e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:01.607354 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98b4ac39-6b12-4fc5-b5cc-5b501945a00e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:01.607840 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98b4ac39-6b12-4fc5-b5cc-5b501945a00e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:01.608269 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98b4ac39-6b12-4fc5-b5cc-5b501945a00e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:01.608954 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98b4ac39-6b12-4fc5-b5cc-5b501945a00e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:01.609407 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98b4ac39-6b12-4fc5-b5cc-5b501945a00e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:01.609826 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-98b4ac39-6b12-4fc5-b5cc-5b501945a00e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:01.740123 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-98b4ac39-6b12-4fc5-b5cc-5b501945a00e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:01.747936 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-98b4ac39-6b12-4fc5-b5cc-5b501945a00e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1665 microversion: 2.1 time: 0.151916 Nov 02 07:39:01.748626 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 492/981] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:01 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:19.149616 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-f0bf2075-a741-4638-a137-0c2668d50af8 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:19.150139 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-f0bf2075-a741-4638-a137-0c2668d50af8 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:19.152482 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=13 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:19.153323 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:19.158466 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f0bf2075-a741-4638-a137-0c2668d50af8 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:19.158944 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f0bf2075-a741-4638-a137-0c2668d50af8 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:19.159860 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f0bf2075-a741-4638-a137-0c2668d50af8 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:19.160548 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f0bf2075-a741-4638-a137-0c2668d50af8 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:19.160990 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f0bf2075-a741-4638-a137-0c2668d50af8 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:19.161404 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-f0bf2075-a741-4638-a137-0c2668d50af8 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:19.466813 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-f0bf2075-a741-4638-a137-0c2668d50af8 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lazy-loading 'services' on Instance uuid dc3283b2-ed59-44f4-b90a-04df83443560 {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:39:19.539115 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-f0bf2075-a741-4638-a137-0c2668d50af8 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560/os-volume_attachments/95e55334-07d1-420b-930a-1506af471415" status: 202 len: 0 microversion: 2.1 time: 0.393268 Nov 02 07:39:19.539774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 490/982] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 07:39:19 2022] DELETE /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560/os-volume_attachments/95e55334-07d1-420b-930a-1506af471415 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:39:20.665031 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-07bdd433-24eb-4b22-a29d-48f0a92cd30a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:20.665533 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-07bdd433-24eb-4b22-a29d-48f0a92cd30a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:20.668129 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=13 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:20.668795 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:20.674324 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07bdd433-24eb-4b22-a29d-48f0a92cd30a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:20.674833 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07bdd433-24eb-4b22-a29d-48f0a92cd30a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:20.675263 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07bdd433-24eb-4b22-a29d-48f0a92cd30a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:20.675951 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07bdd433-24eb-4b22-a29d-48f0a92cd30a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:20.677046 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07bdd433-24eb-4b22-a29d-48f0a92cd30a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:20.677469 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-07bdd433-24eb-4b22-a29d-48f0a92cd30a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:20.703356 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-07bdd433-24eb-4b22-a29d-48f0a92cd30a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Going to try to terminate instance {{(pid=118991) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:39:20.777836 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-07bdd433-24eb-4b22-a29d-48f0a92cd30a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560" status: 204 len: 0 microversion: 2.1 time: 0.116830 Nov 02 07:39:20.778439 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 493/983] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:39:20 2022] DELETE /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:39:20.787964 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-68cd460f-8016-428d-89ca-0d21cb9b8c34 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:20.788655 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-68cd460f-8016-428d-89ca-0d21cb9b8c34 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:20.794857 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68cd460f-8016-428d-89ca-0d21cb9b8c34 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:20.795349 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68cd460f-8016-428d-89ca-0d21cb9b8c34 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:20.795756 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68cd460f-8016-428d-89ca-0d21cb9b8c34 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:20.796443 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68cd460f-8016-428d-89ca-0d21cb9b8c34 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:20.796890 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68cd460f-8016-428d-89ca-0d21cb9b8c34 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:20.797306 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-68cd460f-8016-428d-89ca-0d21cb9b8c34 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:20.928538 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-68cd460f-8016-428d-89ca-0d21cb9b8c34 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:20.936365 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-68cd460f-8016-428d-89ca-0d21cb9b8c34 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560" status: 200 len: 1513 microversion: 2.1 time: 0.153092 Nov 02 07:39:20.936920 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 491/984] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:20 2022] GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:21.961360 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-04fdca30-ec75-47ed-844f-87577a74807b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:21.962018 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-04fdca30-ec75-47ed-844f-87577a74807b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:21.968470 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-04fdca30-ec75-47ed-844f-87577a74807b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:21.968950 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-04fdca30-ec75-47ed-844f-87577a74807b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:21.969386 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-04fdca30-ec75-47ed-844f-87577a74807b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:21.970067 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-04fdca30-ec75-47ed-844f-87577a74807b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:21.970570 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-04fdca30-ec75-47ed-844f-87577a74807b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:21.970993 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-04fdca30-ec75-47ed-844f-87577a74807b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:22.201124 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-04fdca30-ec75-47ed-844f-87577a74807b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:22.208798 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-04fdca30-ec75-47ed-844f-87577a74807b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560" status: 200 len: 1513 microversion: 2.1 time: 0.252439 Nov 02 07:39:22.209361 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 494/985] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:21 2022] GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 => generated 1513 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:23.102732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-37ce03b8-1a63-4848-b4e1-af41e6b66bb3 req-22009272-a928-4751-b5b7-0327531985f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc3283b2-ed59-44f4-b90a-04df83443560", "name": "network-vif-deleted", "tag": "fa1663f1-c844-458e-af96-4e8b2b70952f"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:39:23.112563 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-37ce03b8-1a63-4848-b4e1-af41e6b66bb3 req-22009272-a928-4751-b5b7-0327531985f0 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:23.113263 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-37ce03b8-1a63-4848-b4e1-af41e6b66bb3 req-22009272-a928-4751-b5b7-0327531985f0 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:23.113678 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-37ce03b8-1a63-4848-b4e1-af41e6b66bb3 req-22009272-a928-4751-b5b7-0327531985f0 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:23.125069 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-37ce03b8-1a63-4848-b4e1-af41e6b66bb3 req-22009272-a928-4751-b5b7-0327531985f0 service nova] Creating event network-vif-deleted:fa1663f1-c844-458e-af96-4e8b2b70952f for instance dc3283b2-ed59-44f4-b90a-04df83443560 on hv-cinder-80473 Nov 02 07:39:23.129646 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-37ce03b8-1a63-4848-b4e1-af41e6b66bb3 req-22009272-a928-4751-b5b7-0327531985f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030846 Nov 02 07:39:23.131143 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 492/986] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:39:23.232442 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-eade1dcc-d2ea-4b0d-a9b4-08d98d2a1a6b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:23.232995 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-eade1dcc-d2ea-4b0d-a9b4-08d98d2a1a6b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:23.239895 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eade1dcc-d2ea-4b0d-a9b4-08d98d2a1a6b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:23.240377 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eade1dcc-d2ea-4b0d-a9b4-08d98d2a1a6b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:23.240877 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eade1dcc-d2ea-4b0d-a9b4-08d98d2a1a6b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:23.241564 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eade1dcc-d2ea-4b0d-a9b4-08d98d2a1a6b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:23.242012 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eade1dcc-d2ea-4b0d-a9b4-08d98d2a1a6b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:23.242458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eade1dcc-d2ea-4b0d-a9b4-08d98d2a1a6b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:23.277474 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eade1dcc-d2ea-4b0d-a9b4-08d98d2a1a6b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:23.277963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eade1dcc-d2ea-4b0d-a9b4-08d98d2a1a6b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:23.278394 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-eade1dcc-d2ea-4b0d-a9b4-08d98d2a1a6b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:23.278849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.objects.instance [None req-eade1dcc-d2ea-4b0d-a9b4-08d98d2a1a6b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lazy-loading 'fault' on Instance uuid dc3283b2-ed59-44f4-b90a-04df83443560 {{(pid=118991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:39:23.322228 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-eade1dcc-d2ea-4b0d-a9b4-08d98d2a1a6b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:23.329972 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-eade1dcc-d2ea-4b0d-a9b4-08d98d2a1a6b tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560" status: 200 len: 1308 microversion: 2.1 time: 0.101423 Nov 02 07:39:23.330576 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 495/987] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:23 2022] GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:24.355901 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-09160528-8cb7-4410-849c-4fbf30163c0d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:24.356604 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-09160528-8cb7-4410-849c-4fbf30163c0d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: dc3283b2-ed59-44f4-b90a-04df83443560] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:24.362808 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-09160528-8cb7-4410-849c-4fbf30163c0d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:24.363287 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-09160528-8cb7-4410-849c-4fbf30163c0d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:24.363722 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-09160528-8cb7-4410-849c-4fbf30163c0d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:24.365043 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-09160528-8cb7-4410-849c-4fbf30163c0d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:24.365498 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-09160528-8cb7-4410-849c-4fbf30163c0d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:24.365922 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-09160528-8cb7-4410-849c-4fbf30163c0d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:24.379036 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-09160528-8cb7-4410-849c-4fbf30163c0d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] HTTP exception thrown: Instance dc3283b2-ed59-44f4-b90a-04df83443560 could not be found. Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-09160528-8cb7-4410-849c-4fbf30163c0d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Request method failure captured: Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 HTTP/1.1 Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYh5y0Lt8CKpLB56IU7fWnLExFXI6xOriVPWw6k7IQ7Ln7cHSvjmtSv4Q5dGL_C5wadvZ_3HvhB2lONwbSMRjiRKyrdm6tT1o2OZgouXMHwdT9zy6pAfWpfsbjnfIAYZQuf44aGV9zFJ-9U_CGq6KWRyXhRfrSK_euqbd2k20XLB_lhQ Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: 5c30df4815d74ad3a0805a7e0ee259a6 Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1536594870 Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:39:24.380657 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:39:24.382313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c30df4815d74ad3a0805a7e0ee259a6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c30df4815d74ad3a0805a7e0ee259a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c30df4815d74ad3a0805a7e0ee259a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c30df4815d74ad3a0805a7e0ee259a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:39:24.382313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-VolumesSnapshotTestJSON-1536594870 Nov 02 07:39:24.382313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: 5c30df4815d74ad3a0805a7e0ee259a6 Nov 02 07:39:24.382313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1536594870 Nov 02 07:39:24.382313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-VolumesSnapshotTestJSON-1536594870-project Nov 02 07:39:24.382313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:39:24.382313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:39:24.382313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 8c67a36d80e845818623cd258a3456fa Nov 02 07:39:24.382313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-VolumesSnapshotTestJSON-1536594870-project Nov 02 07:39:24.382313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:39:24.382313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance dc3283b2-ed59-44f4-b90a-04df83443560 could not be found. Nov 02 07:39:24.382313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': 'dc3283b2-ed59-44f4-b90a-04df83443560'} Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc3283b2-ed59-44f4-b90a-04df83443560 could not be found. Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:39:24.383292 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc3283b2-ed59-44f4-b90a-04df83443560 could not be found. Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc3283b2-ed59-44f4-b90a-04df83443560 could not be found. Nov 02 07:39:24.384872 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:39:24.386293 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-09160528-8cb7-4410-849c-4fbf30163c0d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Returning 404 to user: Instance dc3283b2-ed59-44f4-b90a-04df83443560 could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:39:24.386293 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-09160528-8cb7-4410-849c-4fbf30163c0d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560" status: 404 len: 111 microversion: 2.1 time: 0.030848 Nov 02 07:39:24.386293 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 493/988] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:24 2022] GET /compute/v2.1/servers/dc3283b2-ed59-44f4-b90a-04df83443560 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:39:32.206115 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-36386306", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452", "networks": [{"uuid": "25540d19-7bb3-4b5f-b387-4dee03cfded6"}]}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:39:32.261262 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.network.neutron [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] validate_networks() for [('25540d19-7bb3-4b5f-b387-4dee03cfded6', None, None, None, None, None)] {{(pid=118991) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:39:32.623425 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Flavor limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:39:32.623845 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Image limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:39:32.624315 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Flavor pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:39:32.624717 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Image pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:39:32.625120 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:39:32.633819 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:32.634296 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:32.634761 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:32.635507 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:32.635961 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:32.636384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:32.653467 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Getting quotas for project 5c30df4815d74ad3a0805a7e0ee259a6. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:39:32.657695 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Getting quotas for user 8c67a36d80e845818623cd258a3456fa and project 5c30df4815d74ad3a0805a7e0ee259a6. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:39:32.669203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Going to run 1 instances... {{(pid=118991) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:39:32.671509 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:39:32.717520 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-688b8a30-ec03-43d4-b8f8-84fb61c833d5 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515226 Nov 02 07:39:32.718155 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 496/989] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:39:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 07:39:32.730042 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-162cfd28-8c5d-4d74-ac8d-c1e2515aeb18 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:32.730699 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-162cfd28-8c5d-4d74-ac8d-c1e2515aeb18 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:32.784663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-162cfd28-8c5d-4d74-ac8d-c1e2515aeb18 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:32.792068 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-162cfd28-8c5d-4d74-ac8d-c1e2515aeb18 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 200 len: 1217 microversion: 2.1 time: 0.066077 Nov 02 07:39:32.792620 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 494/990] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:32 2022] GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:39:33.815040 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-154768d1-1dac-4a7d-98b7-ec7f945039e7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:33.815648 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-154768d1-1dac-4a7d-98b7-ec7f945039e7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:33.867974 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-154768d1-1dac-4a7d-98b7-ec7f945039e7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:33.875529 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-154768d1-1dac-4a7d-98b7-ec7f945039e7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 200 len: 1217 microversion: 2.1 time: 0.064905 Nov 02 07:39:33.876079 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 497/991] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:33 2022] GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:34.899521 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ba1ee668-9478-4487-80b1-e69090f2499e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:34.900057 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ba1ee668-9478-4487-80b1-e69090f2499e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:34.903267 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:34.909153 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ba1ee668-9478-4487-80b1-e69090f2499e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:34.909636 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ba1ee668-9478-4487-80b1-e69090f2499e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:34.910071 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ba1ee668-9478-4487-80b1-e69090f2499e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:34.910785 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ba1ee668-9478-4487-80b1-e69090f2499e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:34.911264 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ba1ee668-9478-4487-80b1-e69090f2499e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:34.911697 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ba1ee668-9478-4487-80b1-e69090f2499e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:34.976670 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ba1ee668-9478-4487-80b1-e69090f2499e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:34.984244 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ba1ee668-9478-4487-80b1-e69090f2499e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 200 len: 1221 microversion: 2.1 time: 0.089353 Nov 02 07:39:34.984808 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 495/992] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:34 2022] GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:36.008635 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-e9759d92-834a-4f7e-89d0-0d52cea80a3e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:36.009252 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-e9759d92-834a-4f7e-89d0-0d52cea80a3e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:36.015835 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e9759d92-834a-4f7e-89d0-0d52cea80a3e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:36.016322 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e9759d92-834a-4f7e-89d0-0d52cea80a3e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:36.016760 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e9759d92-834a-4f7e-89d0-0d52cea80a3e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:36.017463 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e9759d92-834a-4f7e-89d0-0d52cea80a3e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:36.017919 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e9759d92-834a-4f7e-89d0-0d52cea80a3e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:36.018345 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-e9759d92-834a-4f7e-89d0-0d52cea80a3e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:36.085816 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-e9759d92-834a-4f7e-89d0-0d52cea80a3e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:36.093438 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-e9759d92-834a-4f7e-89d0-0d52cea80a3e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 200 len: 1275 microversion: 2.1 time: 0.089997 Nov 02 07:39:36.094006 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 498/993] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:36 2022] GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:37.118150 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-76be3d78-6659-49f0-9ffe-d26ba4f461da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:37.118743 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-76be3d78-6659-49f0-9ffe-d26ba4f461da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:37.125501 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76be3d78-6659-49f0-9ffe-d26ba4f461da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:37.126001 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76be3d78-6659-49f0-9ffe-d26ba4f461da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:37.126479 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76be3d78-6659-49f0-9ffe-d26ba4f461da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:37.127195 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76be3d78-6659-49f0-9ffe-d26ba4f461da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:37.127654 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76be3d78-6659-49f0-9ffe-d26ba4f461da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:37.128104 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-76be3d78-6659-49f0-9ffe-d26ba4f461da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:37.340266 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-76be3d78-6659-49f0-9ffe-d26ba4f461da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:37.348106 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-76be3d78-6659-49f0-9ffe-d26ba4f461da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 200 len: 1317 microversion: 2.1 time: 0.234139 Nov 02 07:39:37.348679 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 496/994] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:37 2022] GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:37.663182 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-3fa37eaf-5967-41b7-b16e-7a550e77d31b req-649bba6e-b63e-4f76-8bb5-422c57985fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3974cb25-0080-4e8b-bf7a-f037210f594a", "tag": "7f4bd317-1cce-4be6-bca0-9d83628ac27d"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:39:37.673825 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-3fa37eaf-5967-41b7-b16e-7a550e77d31b req-649bba6e-b63e-4f76-8bb5-422c57985fb5 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:37.674476 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-3fa37eaf-5967-41b7-b16e-7a550e77d31b req-649bba6e-b63e-4f76-8bb5-422c57985fb5 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:37.675967 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-3fa37eaf-5967-41b7-b16e-7a550e77d31b req-649bba6e-b63e-4f76-8bb5-422c57985fb5 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:37.688604 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-3fa37eaf-5967-41b7-b16e-7a550e77d31b req-649bba6e-b63e-4f76-8bb5-422c57985fb5 service nova] Creating event network-changed:7f4bd317-1cce-4be6-bca0-9d83628ac27d for instance 3974cb25-0080-4e8b-bf7a-f037210f594a on hv-cinder-80473 Nov 02 07:39:37.694457 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-3fa37eaf-5967-41b7-b16e-7a550e77d31b req-649bba6e-b63e-4f76-8bb5-422c57985fb5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036408 Nov 02 07:39:37.695057 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 499/995] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:39:38.371481 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-83737545-7f78-4e55-8bdc-6fb4f8972a89 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:38.372079 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-83737545-7f78-4e55-8bdc-6fb4f8972a89 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:38.378626 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83737545-7f78-4e55-8bdc-6fb4f8972a89 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:38.379109 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83737545-7f78-4e55-8bdc-6fb4f8972a89 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:38.379540 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83737545-7f78-4e55-8bdc-6fb4f8972a89 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:38.381020 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83737545-7f78-4e55-8bdc-6fb4f8972a89 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:38.381480 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83737545-7f78-4e55-8bdc-6fb4f8972a89 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:38.381907 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-83737545-7f78-4e55-8bdc-6fb4f8972a89 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:38.511819 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-83737545-7f78-4e55-8bdc-6fb4f8972a89 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:38.519720 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-83737545-7f78-4e55-8bdc-6fb4f8972a89 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 200 len: 1317 microversion: 2.1 time: 0.152126 Nov 02 07:39:38.520286 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 497/996] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:38 2022] GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:39.543681 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-28ef3368-89ea-4eba-a2a5-a4b2d8f30f8e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:39.544409 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-28ef3368-89ea-4eba-a2a5-a4b2d8f30f8e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:39.550594 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-28ef3368-89ea-4eba-a2a5-a4b2d8f30f8e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:39.551075 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-28ef3368-89ea-4eba-a2a5-a4b2d8f30f8e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:39.551509 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-28ef3368-89ea-4eba-a2a5-a4b2d8f30f8e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:39.552536 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-28ef3368-89ea-4eba-a2a5-a4b2d8f30f8e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:39.552770 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-28ef3368-89ea-4eba-a2a5-a4b2d8f30f8e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:39.553202 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-28ef3368-89ea-4eba-a2a5-a4b2d8f30f8e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:39.684267 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-28ef3368-89ea-4eba-a2a5-a4b2d8f30f8e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:39.691958 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-28ef3368-89ea-4eba-a2a5-a4b2d8f30f8e tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 200 len: 1317 microversion: 2.1 time: 0.153026 Nov 02 07:39:39.692523 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 500/997] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:39 2022] GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:40.120892 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ae4dd3b8-06d1-49a6-8cb6-87520f50e2ac tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:40.123060 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ae4dd3b8-06d1-49a6-8cb6-87520f50e2ac tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:40.129394 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ae4dd3b8-06d1-49a6-8cb6-87520f50e2ac tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:40.129870 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ae4dd3b8-06d1-49a6-8cb6-87520f50e2ac tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:40.130934 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ae4dd3b8-06d1-49a6-8cb6-87520f50e2ac tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:40.131681 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ae4dd3b8-06d1-49a6-8cb6-87520f50e2ac tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:40.132131 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ae4dd3b8-06d1-49a6-8cb6-87520f50e2ac tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:40.132544 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ae4dd3b8-06d1-49a6-8cb6-87520f50e2ac tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:40.161447 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ae4dd3b8-06d1-49a6-8cb6-87520f50e2ac tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044440 Nov 02 07:39:40.161993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 498/998] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 07:39:40 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 07:39:40.224990 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-88f4c6f8-9707-4c5d-a32f-5497a2222339 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:40.225478 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-88f4c6f8-9707-4c5d-a32f-5497a2222339 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:40.231350 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-88f4c6f8-9707-4c5d-a32f-5497a2222339 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:40.231828 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-88f4c6f8-9707-4c5d-a32f-5497a2222339 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:40.232256 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-88f4c6f8-9707-4c5d-a32f-5497a2222339 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:40.232935 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-88f4c6f8-9707-4c5d-a32f-5497a2222339 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:40.233381 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-88f4c6f8-9707-4c5d-a32f-5497a2222339 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:40.233796 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-88f4c6f8-9707-4c5d-a32f-5497a2222339 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:40.258345 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-88f4c6f8-9707-4c5d-a32f-5497a2222339 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Going to try to terminate instance {{(pid=118991) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:39:40.332764 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-88f4c6f8-9707-4c5d-a32f-5497a2222339 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "DELETE /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 204 len: 0 microversion: 2.1 time: 0.111260 Nov 02 07:39:40.333963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 501/999] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:39:40 2022] DELETE /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:39:40.343332 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-9890aa88-2eec-4ae0-abda-2b576a41169a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:40.343939 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-9890aa88-2eec-4ae0-abda-2b576a41169a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:40.351122 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9890aa88-2eec-4ae0-abda-2b576a41169a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:40.351600 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9890aa88-2eec-4ae0-abda-2b576a41169a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:40.352030 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9890aa88-2eec-4ae0-abda-2b576a41169a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:40.352711 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9890aa88-2eec-4ae0-abda-2b576a41169a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:40.353160 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9890aa88-2eec-4ae0-abda-2b576a41169a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:40.353576 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-9890aa88-2eec-4ae0-abda-2b576a41169a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:40.480666 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-9890aa88-2eec-4ae0-abda-2b576a41169a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:40.488344 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-9890aa88-2eec-4ae0-abda-2b576a41169a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1671 microversion: 2.1 time: 0.149143 Nov 02 07:39:40.488901 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 499/1000] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:40 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:40.716012 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-be14b5c0-b499-4aa8-952a-a3d8b564ea75 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:40.716717 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-be14b5c0-b499-4aa8-952a-a3d8b564ea75 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:40.723280 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-be14b5c0-b499-4aa8-952a-a3d8b564ea75 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:40.723774 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-be14b5c0-b499-4aa8-952a-a3d8b564ea75 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:40.724222 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-be14b5c0-b499-4aa8-952a-a3d8b564ea75 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:40.724928 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-be14b5c0-b499-4aa8-952a-a3d8b564ea75 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:40.725375 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-be14b5c0-b499-4aa8-952a-a3d8b564ea75 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:40.725797 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-be14b5c0-b499-4aa8-952a-a3d8b564ea75 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:40.856221 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-be14b5c0-b499-4aa8-952a-a3d8b564ea75 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:40.863844 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-be14b5c0-b499-4aa8-952a-a3d8b564ea75 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 200 len: 1317 microversion: 2.1 time: 0.152173 Nov 02 07:39:40.864403 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 502/1001] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:40 2022] GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:41.511996 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ffb22bd4-0fee-414d-8cd4-a873ec369cad tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:41.512615 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ffb22bd4-0fee-414d-8cd4-a873ec369cad tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:41.519359 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ffb22bd4-0fee-414d-8cd4-a873ec369cad tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:41.519869 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ffb22bd4-0fee-414d-8cd4-a873ec369cad tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:41.520306 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ffb22bd4-0fee-414d-8cd4-a873ec369cad tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:41.521048 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ffb22bd4-0fee-414d-8cd4-a873ec369cad tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:41.521545 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ffb22bd4-0fee-414d-8cd4-a873ec369cad tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:41.521968 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ffb22bd4-0fee-414d-8cd4-a873ec369cad tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:41.652566 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ffb22bd4-0fee-414d-8cd4-a873ec369cad tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:41.660625 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ffb22bd4-0fee-414d-8cd4-a873ec369cad tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1671 microversion: 2.1 time: 0.152579 Nov 02 07:39:41.661236 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 500/1002] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:41 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:41.887132 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d6697622-b397-4118-8fa9-dcdc67721168 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:41.887786 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-d6697622-b397-4118-8fa9-dcdc67721168 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:41.894849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d6697622-b397-4118-8fa9-dcdc67721168 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:41.895334 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d6697622-b397-4118-8fa9-dcdc67721168 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:41.895768 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d6697622-b397-4118-8fa9-dcdc67721168 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:41.896461 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d6697622-b397-4118-8fa9-dcdc67721168 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:41.896913 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d6697622-b397-4118-8fa9-dcdc67721168 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:41.897335 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d6697622-b397-4118-8fa9-dcdc67721168 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:42.029732 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-d6697622-b397-4118-8fa9-dcdc67721168 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:42.038664 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d6697622-b397-4118-8fa9-dcdc67721168 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 200 len: 1317 microversion: 2.1 time: 0.155407 Nov 02 07:39:42.039951 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 503/1003] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:41 2022] GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:42.684387 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-267b3d0e-ae9a-42e7-a0a4-2d8ab3c7fc2f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:42.684994 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-267b3d0e-ae9a-42e7-a0a4-2d8ab3c7fc2f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:42.687267 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 07:39:42.687410 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Wed Nov 2 07:39:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 (ip 10.222.0.18) !!! Nov 02 07:39:42.694834 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-267b3d0e-ae9a-42e7-a0a4-2d8ab3c7fc2f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:42.695339 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-267b3d0e-ae9a-42e7-a0a4-2d8ab3c7fc2f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:42.695774 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-267b3d0e-ae9a-42e7-a0a4-2d8ab3c7fc2f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:42.696480 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-267b3d0e-ae9a-42e7-a0a4-2d8ab3c7fc2f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:42.696932 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-267b3d0e-ae9a-42e7-a0a4-2d8ab3c7fc2f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:42.697353 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-267b3d0e-ae9a-42e7-a0a4-2d8ab3c7fc2f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:42.789858 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=2 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:43.062812 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-aea1b00c-ad0d-4de3-ad35-defba1132a3d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:43.063399 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-aea1b00c-ad0d-4de3-ad35-defba1132a3d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:43.065391 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:43.071804 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-aea1b00c-ad0d-4de3-ad35-defba1132a3d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:43.072293 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-aea1b00c-ad0d-4de3-ad35-defba1132a3d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:43.072729 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-aea1b00c-ad0d-4de3-ad35-defba1132a3d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:43.073442 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-aea1b00c-ad0d-4de3-ad35-defba1132a3d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:43.073892 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-aea1b00c-ad0d-4de3-ad35-defba1132a3d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:43.074315 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-aea1b00c-ad0d-4de3-ad35-defba1132a3d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:43.266132 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-267b3d0e-ae9a-42e7-a0a4-2d8ab3c7fc2f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:43.274340 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-267b3d0e-ae9a-42e7-a0a4-2d8ab3c7fc2f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1671 microversion: 2.1 time: 0.593687 Nov 02 07:39:43.275356 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 501/1004] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:42 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1671 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:39:43.337010 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-aea1b00c-ad0d-4de3-ad35-defba1132a3d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:43.344703 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-aea1b00c-ad0d-4de3-ad35-defba1132a3d tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 200 len: 1317 microversion: 2.1 time: 0.285915 Nov 02 07:39:43.345267 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 504/1005] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:43 2022] GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:39:43.642797 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-f9ce796e-a58b-4e1c-b794-02505f3cc3bb req-76cb76df-c07f-46cd-a4fb-7af8abbea4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3974cb25-0080-4e8b-bf7a-f037210f594a", "name": "network-vif-plugged", "status": "completed", "tag": "7f4bd317-1cce-4be6-bca0-9d83628ac27d"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:39:43.656784 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-f9ce796e-a58b-4e1c-b794-02505f3cc3bb req-76cb76df-c07f-46cd-a4fb-7af8abbea4a7 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:43.657397 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-f9ce796e-a58b-4e1c-b794-02505f3cc3bb req-76cb76df-c07f-46cd-a4fb-7af8abbea4a7 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:43.657952 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-f9ce796e-a58b-4e1c-b794-02505f3cc3bb req-76cb76df-c07f-46cd-a4fb-7af8abbea4a7 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:43.670131 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-f9ce796e-a58b-4e1c-b794-02505f3cc3bb req-76cb76df-c07f-46cd-a4fb-7af8abbea4a7 service nova] Creating event network-vif-plugged:7f4bd317-1cce-4be6-bca0-9d83628ac27d for instance 3974cb25-0080-4e8b-bf7a-f037210f594a on hv-cinder-80473 Nov 02 07:39:43.675271 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-f9ce796e-a58b-4e1c-b794-02505f3cc3bb req-76cb76df-c07f-46cd-a4fb-7af8abbea4a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037411 Nov 02 07:39:43.676146 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 502/1006] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:39:43.740146 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-f3022b4c-e614-4df9-9ce6-5d598b421e5c req-0a15bfbc-bb97-4377-8aa7-3bf7e940121e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954fa08b-6370-4f1b-955f-d3c2efe8ba34", "name": "network-vif-deleted", "tag": "166f7253-1dcb-4eb0-b3b0-f74792201a1f"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:39:43.749436 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-f3022b4c-e614-4df9-9ce6-5d598b421e5c req-0a15bfbc-bb97-4377-8aa7-3bf7e940121e service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:43.749910 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-f3022b4c-e614-4df9-9ce6-5d598b421e5c req-0a15bfbc-bb97-4377-8aa7-3bf7e940121e service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:43.750577 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-f3022b4c-e614-4df9-9ce6-5d598b421e5c req-0a15bfbc-bb97-4377-8aa7-3bf7e940121e service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:43.764258 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-f3022b4c-e614-4df9-9ce6-5d598b421e5c req-0a15bfbc-bb97-4377-8aa7-3bf7e940121e service nova] Creating event network-vif-deleted:166f7253-1dcb-4eb0-b3b0-f74792201a1f for instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 on hv-cinder-80473 Nov 02 07:39:43.769419 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-f3022b4c-e614-4df9-9ce6-5d598b421e5c req-0a15bfbc-bb97-4377-8aa7-3bf7e940121e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033313 Nov 02 07:39:43.770875 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 505/1007] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:39:44.299965 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e1aec152-d1be-4ee8-9220-613068033edc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:44.300681 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e1aec152-d1be-4ee8-9220-613068033edc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:44.307370 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e1aec152-d1be-4ee8-9220-613068033edc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:44.307843 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e1aec152-d1be-4ee8-9220-613068033edc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:44.308268 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e1aec152-d1be-4ee8-9220-613068033edc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:44.308951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e1aec152-d1be-4ee8-9220-613068033edc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:44.309398 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e1aec152-d1be-4ee8-9220-613068033edc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:44.309816 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e1aec152-d1be-4ee8-9220-613068033edc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:44.341610 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e1aec152-d1be-4ee8-9220-613068033edc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:44.342086 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e1aec152-d1be-4ee8-9220-613068033edc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:44.342550 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e1aec152-d1be-4ee8-9220-613068033edc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:44.342987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-e1aec152-d1be-4ee8-9220-613068033edc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lazy-loading 'fault' on Instance uuid 954fa08b-6370-4f1b-955f-d3c2efe8ba34 {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:39:44.366529 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=8 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:44.371439 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c5d3607a-c5d4-4bb3-b393-5642dc92677f tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:44.372148 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c5d3607a-c5d4-4bb3-b393-5642dc92677f tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:44.379380 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c5d3607a-c5d4-4bb3-b393-5642dc92677f tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:44.379380 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c5d3607a-c5d4-4bb3-b393-5642dc92677f tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:44.381605 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c5d3607a-c5d4-4bb3-b393-5642dc92677f tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:44.382261 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c5d3607a-c5d4-4bb3-b393-5642dc92677f tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:44.382749 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c5d3607a-c5d4-4bb3-b393-5642dc92677f tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:44.383288 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c5d3607a-c5d4-4bb3-b393-5642dc92677f tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:44.386268 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-e1aec152-d1be-4ee8-9220-613068033edc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:44.394720 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e1aec152-d1be-4ee8-9220-613068033edc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 200 len: 1326 microversion: 2.1 time: 0.099284 Nov 02 07:39:44.395409 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 503/1008] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:44 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:44.517825 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c5d3607a-c5d4-4bb3-b393-5642dc92677f tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:44.526196 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c5d3607a-c5d4-4bb3-b393-5642dc92677f tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 200 len: 1317 microversion: 2.1 time: 0.160626 Nov 02 07:39:44.526810 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 506/1009] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:44 2022] GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:39:45.418116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-02ae321c-e173-46b6-91de-ed249060b891 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:45.418759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-02ae321c-e173-46b6-91de-ed249060b891 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:45.425165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-02ae321c-e173-46b6-91de-ed249060b891 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:45.425645 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-02ae321c-e173-46b6-91de-ed249060b891 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:45.426109 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-02ae321c-e173-46b6-91de-ed249060b891 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:45.426855 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-02ae321c-e173-46b6-91de-ed249060b891 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:45.427351 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-02ae321c-e173-46b6-91de-ed249060b891 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:45.427814 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-02ae321c-e173-46b6-91de-ed249060b891 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:45.443230 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-02ae321c-e173-46b6-91de-ed249060b891 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] HTTP exception thrown: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-02ae321c-e173-46b6-91de-ed249060b891 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Request method failure captured: Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 HTTP/1.1 Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYh36LEfeFkt1tDIlX84T3wn87xqb6YMlwASIZ_sY0TYj16_sgpIkQLY4jzIzkLJpoSUQhK0xONGqpapZgqXVlOUKZTbfsiQ4e4AwGntE7eWYiNc3ocCK5E4S09croOCEcYwHOp5UQIQURGSa5kpR5CdEnGecyf-Awbbll8hU3j4eBv8 Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: 86cca0dcb21a47e483458b36e33f5036 Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:39:45.444839 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:39:45.446533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_86cca0dcb21a47e483458b36e33f5036", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:39:45.446533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:39:45.446533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: 86cca0dcb21a47e483458b36e33f5036 Nov 02 07:39:45.446533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:39:45.446533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-AttachVolumeTestJSON-605350857-project Nov 02 07:39:45.446533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:39:45.446533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:39:45.446533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 33c63dc278ac4eb79d2a4553fcbeda4f Nov 02 07:39:45.446533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-AttachVolumeTestJSON-605350857-project Nov 02 07:39:45.446533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:39:45.446533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. Nov 02 07:39:45.446533 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '954fa08b-6370-4f1b-955f-d3c2efe8ba34'} Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:39:45.447530 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. Nov 02 07:39:45.449100 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:39:45.450510 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-02ae321c-e173-46b6-91de-ed249060b891 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Returning 404 to user: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:39:45.450510 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-02ae321c-e173-46b6-91de-ed249060b891 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 404 len: 111 microversion: 2.1 time: 0.031967 Nov 02 07:39:45.450510 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 504/1010] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:45 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:39:45.454927 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-cf64b332-166c-483f-a3d6-b629b899b739 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '.version_select at 0x7f4d6a456af0>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:45.473589 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-cf64b332-166c-483f-a3d6-b629b899b739 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-876311742" status: 202 len: 0 microversion: 2.1 time: 0.022434 Nov 02 07:39:45.474270 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 507/1011] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 07:39:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-876311742 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:39:45.550509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a66abf00-1080-4952-8824-38f5294910f7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:45.551285 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a66abf00-1080-4952-8824-38f5294910f7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:45.557834 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a66abf00-1080-4952-8824-38f5294910f7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:45.558447 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a66abf00-1080-4952-8824-38f5294910f7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:45.559226 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a66abf00-1080-4952-8824-38f5294910f7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:45.559999 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a66abf00-1080-4952-8824-38f5294910f7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:45.560681 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a66abf00-1080-4952-8824-38f5294910f7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:45.561265 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a66abf00-1080-4952-8824-38f5294910f7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:45.705120 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a66abf00-1080-4952-8824-38f5294910f7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:45.713595 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a66abf00-1080-4952-8824-38f5294910f7 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 200 len: 1507 microversion: 2.1 time: 0.167434 Nov 02 07:39:45.714157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 505/1012] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:45 2022] GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:45.736757 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-55acca65-76d1-464e-adaa-fb42368e442a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ac36788-522d-4994-8fdd-2687e25252e5", "device": "/dev/sdb"}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:39:45.739131 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-55acca65-76d1-464e-adaa-fb42368e442a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:45.745905 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-55acca65-76d1-464e-adaa-fb42368e442a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:45.746415 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-55acca65-76d1-464e-adaa-fb42368e442a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:45.746847 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-55acca65-76d1-464e-adaa-fb42368e442a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:45.747535 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-55acca65-76d1-464e-adaa-fb42368e442a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:45.747980 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-55acca65-76d1-464e-adaa-fb42368e442a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:45.748399 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-55acca65-76d1-464e-adaa-fb42368e442a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:45.990267 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:46.010032 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-55acca65-76d1-464e-adaa-fb42368e442a tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "POST /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277008 Nov 02 07:39:46.010701 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 508/1013] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 07:39:45 2022] POST /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:39:46.338019 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-391abce9-8dc9-4237-a2a1-f73a0665b9dc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Action: 'create', calling method: .version_select at 0x7f4d6a11f040>, body: {"keypair": {"name": "tempest-keypair-621290042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYmqFSwLIx9SNHjFWlJIJMYl3tvhNxi11h5UOY4/D8i9EKixpwEVRyKpWz0949yOP8I6kbBUs9+W6d8X7jCJuas7uxle52NTfAWpNR4w61c4EG4Dt9oBglElQMt7HI7jQ=="}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:39:46.354025 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-391abce9-8dc9-4237-a2a1-f73a0665b9dc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Getting quotas for project 86cca0dcb21a47e483458b36e33f5036. Resources: {'key_pairs'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:39:46.357966 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.quota [None req-391abce9-8dc9-4237-a2a1-f73a0665b9dc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Getting quotas for user 33c63dc278ac4eb79d2a4553fcbeda4f and project 86cca0dcb21a47e483458b36e33f5036. Resources: {'key_pairs'} {{(pid=118992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:39:46.380391 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-391abce9-8dc9-4237-a2a1-f73a0665b9dc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046347 Nov 02 07:39:46.380987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 506/1014] 10.222.0.18 () {60 vars in 1159 bytes} [Wed Nov 2 07:39:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:39:47.626218 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1479073468", "imageRef": "744fb2bb-798d-4bee-893a-f36579e9035f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c6f85dd-45ed-4684-846a-c63750ac56e2"}], "security_groups": [{"name": "tempest-securitygroup--1361507648"}], "key_name": "tempest-keypair-621290042", "user_data": "}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:39:47.730659 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.network.neutron [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] validate_networks() for [('5c6f85dd-45ed-4684-846a-c63750ac56e2', None, None, None, None, None)] {{(pid=118991) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 07:39:48.103745 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Flavor limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 07:39:48.104165 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Image limits 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 07:39:48.104635 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Flavor pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 07:39:48.105037 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Image pref 0:0:0 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 07:39:48.105441 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.virt.hardware [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118991) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 07:39:48.114237 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:48.114788 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:48.115244 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:48.115966 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:48.116413 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:48.116834 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:48.133161 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Getting quotas for project 86cca0dcb21a47e483458b36e33f5036. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 07:39:48.137099 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.quota [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Getting quotas for user 33c63dc278ac4eb79d2a4553fcbeda4f and project 86cca0dcb21a47e483458b36e33f5036. Resources: {'ram', 'cores', 'instances'} {{(pid=118991) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 07:39:48.149226 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Going to run 1 instances... {{(pid=118991) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 07:39:48.151630 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='744fb2bb-798d-4bee-893a-f36579e9035f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118991) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 07:39:48.199373 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-600adcab-0664-43cd-9506-dc0a250fcf9e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.578266 Nov 02 07:39:48.200025 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 509/1015] 10.222.0.18 () {60 vars in 1147 bytes} [Wed Nov 2 07:39:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 07:39:48.212313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-10a411b5-670f-42bf-a466-d7c428ab4827 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:48.213015 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-10a411b5-670f-42bf-a466-d7c428ab4827 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:48.266083 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-10a411b5-670f-42bf-a466-d7c428ab4827 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:48.274487 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-10a411b5-670f-42bf-a466-d7c428ab4827 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 200 len: 1237 microversion: 2.1 time: 0.067347 Nov 02 07:39:48.275047 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 507/1016] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:48 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:49.297845 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c4a88ecb-0ff1-4b8f-b908-f8649a8903e4 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:49.298491 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c4a88ecb-0ff1-4b8f-b908-f8649a8903e4 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:49.306378 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c4a88ecb-0ff1-4b8f-b908-f8649a8903e4 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:49.306887 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c4a88ecb-0ff1-4b8f-b908-f8649a8903e4 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:49.307324 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c4a88ecb-0ff1-4b8f-b908-f8649a8903e4 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:49.308046 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c4a88ecb-0ff1-4b8f-b908-f8649a8903e4 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:49.308487 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c4a88ecb-0ff1-4b8f-b908-f8649a8903e4 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:49.308916 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c4a88ecb-0ff1-4b8f-b908-f8649a8903e4 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:49.386001 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c4a88ecb-0ff1-4b8f-b908-f8649a8903e4 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:49.394310 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c4a88ecb-0ff1-4b8f-b908-f8649a8903e4 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 200 len: 1307 microversion: 2.1 time: 0.100874 Nov 02 07:39:49.394908 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 510/1017] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:49 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:50.417801 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2a8f8f02-2e3a-4cb8-a824-9e9ca21d2ff3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:50.418512 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-2a8f8f02-2e3a-4cb8-a824-9e9ca21d2ff3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:50.426483 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:50.433569 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2a8f8f02-2e3a-4cb8-a824-9e9ca21d2ff3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:50.434101 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2a8f8f02-2e3a-4cb8-a824-9e9ca21d2ff3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:50.434628 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2a8f8f02-2e3a-4cb8-a824-9e9ca21d2ff3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:50.435338 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2a8f8f02-2e3a-4cb8-a824-9e9ca21d2ff3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:50.435788 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2a8f8f02-2e3a-4cb8-a824-9e9ca21d2ff3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:50.436365 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2a8f8f02-2e3a-4cb8-a824-9e9ca21d2ff3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:50.689380 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2a8f8f02-2e3a-4cb8-a824-9e9ca21d2ff3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:50.698154 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-2a8f8f02-2e3a-4cb8-a824-9e9ca21d2ff3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 200 len: 1363 microversion: 2.1 time: 0.284243 Nov 02 07:39:50.698830 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 508/1018] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:50 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:50.836967 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-805e2937-780c-4767-a3d6-6bf7ae9f7266 req-9548f532-927e-4359-b9d4-079b862941f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "babe8edf-10cd-4baf-91c6-a75d694f323e", "tag": "7842c2ea-424f-4a73-8ec7-b57ccdf25354"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:39:50.842909 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:50.849897 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-805e2937-780c-4767-a3d6-6bf7ae9f7266 req-9548f532-927e-4359-b9d4-079b862941f8 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:50.850667 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-805e2937-780c-4767-a3d6-6bf7ae9f7266 req-9548f532-927e-4359-b9d4-079b862941f8 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:50.851101 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-805e2937-780c-4767-a3d6-6bf7ae9f7266 req-9548f532-927e-4359-b9d4-079b862941f8 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:50.865111 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-805e2937-780c-4767-a3d6-6bf7ae9f7266 req-9548f532-927e-4359-b9d4-079b862941f8 service nova] Creating event network-changed:7842c2ea-424f-4a73-8ec7-b57ccdf25354 for instance babe8edf-10cd-4baf-91c6-a75d694f323e on hv-cinder-80473 Nov 02 07:39:50.871459 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-805e2937-780c-4767-a3d6-6bf7ae9f7266 req-9548f532-927e-4359-b9d4-079b862941f8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039737 Nov 02 07:39:50.872242 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 511/1019] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:39:51.722287 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-569dfd30-f96f-49f4-bb22-97566039821d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:51.722924 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-569dfd30-f96f-49f4-bb22-97566039821d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:51.729976 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-569dfd30-f96f-49f4-bb22-97566039821d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:51.730503 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-569dfd30-f96f-49f4-bb22-97566039821d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:51.730938 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-569dfd30-f96f-49f4-bb22-97566039821d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:51.731622 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-569dfd30-f96f-49f4-bb22-97566039821d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:51.732068 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-569dfd30-f96f-49f4-bb22-97566039821d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:51.732490 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-569dfd30-f96f-49f4-bb22-97566039821d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:51.857709 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-569dfd30-f96f-49f4-bb22-97566039821d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:51.865544 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-569dfd30-f96f-49f4-bb22-97566039821d tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 200 len: 1363 microversion: 2.1 time: 0.146979 Nov 02 07:39:51.866109 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 509/1020] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:51 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:52.891944 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-66195963-9953-4775-b5ae-1732e36d22f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:52.892713 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-66195963-9953-4775-b5ae-1732e36d22f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:52.902322 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66195963-9953-4775-b5ae-1732e36d22f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:52.903328 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66195963-9953-4775-b5ae-1732e36d22f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:52.903876 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66195963-9953-4775-b5ae-1732e36d22f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:52.904738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66195963-9953-4775-b5ae-1732e36d22f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:52.905275 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66195963-9953-4775-b5ae-1732e36d22f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:52.905713 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-66195963-9953-4775-b5ae-1732e36d22f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:53.108904 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-66195963-9953-4775-b5ae-1732e36d22f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:53.117321 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-66195963-9953-4775-b5ae-1732e36d22f6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 200 len: 1363 microversion: 2.1 time: 0.232328 Nov 02 07:39:53.118008 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 512/1021] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:52 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:54.140035 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2fca37de-225f-4118-baef-30b882506bd3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:54.140900 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-2fca37de-225f-4118-baef-30b882506bd3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:54.147918 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2fca37de-225f-4118-baef-30b882506bd3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:54.148396 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2fca37de-225f-4118-baef-30b882506bd3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:54.148825 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2fca37de-225f-4118-baef-30b882506bd3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:54.149513 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2fca37de-225f-4118-baef-30b882506bd3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:54.149958 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2fca37de-225f-4118-baef-30b882506bd3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:54.150397 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2fca37de-225f-4118-baef-30b882506bd3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:54.281172 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2fca37de-225f-4118-baef-30b882506bd3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:54.289636 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-2fca37de-225f-4118-baef-30b882506bd3 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 200 len: 1363 microversion: 2.1 time: 0.153517 Nov 02 07:39:54.290200 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 510/1022] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:54 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:55.312107 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-c0d7e8b0-0ce1-4783-87ab-2f8636f30faf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:55.312729 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-c0d7e8b0-0ce1-4783-87ab-2f8636f30faf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:55.320194 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c0d7e8b0-0ce1-4783-87ab-2f8636f30faf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:55.320678 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c0d7e8b0-0ce1-4783-87ab-2f8636f30faf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:55.321117 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c0d7e8b0-0ce1-4783-87ab-2f8636f30faf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:55.321808 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c0d7e8b0-0ce1-4783-87ab-2f8636f30faf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:55.322267 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c0d7e8b0-0ce1-4783-87ab-2f8636f30faf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:55.322726 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-c0d7e8b0-0ce1-4783-87ab-2f8636f30faf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:55.448750 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-c0d7e8b0-0ce1-4783-87ab-2f8636f30faf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:55.456293 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-c0d7e8b0-0ce1-4783-87ab-2f8636f30faf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 200 len: 1363 microversion: 2.1 time: 0.148179 Nov 02 07:39:55.457007 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 513/1023] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:55 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:56.480184 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-c0840f86-00fa-4ff6-a4d8-b49432a7d9b2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:56.480835 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-c0840f86-00fa-4ff6-a4d8-b49432a7d9b2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:56.487416 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c0840f86-00fa-4ff6-a4d8-b49432a7d9b2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:56.487903 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c0840f86-00fa-4ff6-a4d8-b49432a7d9b2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:56.488350 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c0840f86-00fa-4ff6-a4d8-b49432a7d9b2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:56.489086 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c0840f86-00fa-4ff6-a4d8-b49432a7d9b2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:56.489538 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c0840f86-00fa-4ff6-a4d8-b49432a7d9b2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:56.490211 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-c0840f86-00fa-4ff6-a4d8-b49432a7d9b2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:56.618143 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-c0840f86-00fa-4ff6-a4d8-b49432a7d9b2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:56.625832 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-c0840f86-00fa-4ff6-a4d8-b49432a7d9b2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 200 len: 1363 microversion: 2.1 time: 0.149650 Nov 02 07:39:56.626412 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 511/1024] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:56 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:57.649080 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-cd44698b-c491-4c04-83db-730e30cd3432 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:57.649786 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-cd44698b-c491-4c04-83db-730e30cd3432 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:57.656386 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd44698b-c491-4c04-83db-730e30cd3432 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:57.656866 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd44698b-c491-4c04-83db-730e30cd3432 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:57.657294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd44698b-c491-4c04-83db-730e30cd3432 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:57.657985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd44698b-c491-4c04-83db-730e30cd3432 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:57.658461 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd44698b-c491-4c04-83db-730e30cd3432 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:57.658914 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cd44698b-c491-4c04-83db-730e30cd3432 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:57.785866 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-cd44698b-c491-4c04-83db-730e30cd3432 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:57.793749 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-cd44698b-c491-4c04-83db-730e30cd3432 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 200 len: 1363 microversion: 2.1 time: 0.148863 Nov 02 07:39:57.794320 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 514/1025] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:57 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:58.817278 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-095c0a7c-e99c-4bd5-b756-5760b5cc2baf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:58.817889 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-095c0a7c-e99c-4bd5-b756-5760b5cc2baf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:58.821135 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell0:SELECT=6 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:58.826911 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-095c0a7c-e99c-4bd5-b756-5760b5cc2baf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:58.827385 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-095c0a7c-e99c-4bd5-b756-5760b5cc2baf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:58.827756 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-095c0a7c-e99c-4bd5-b756-5760b5cc2baf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:58.828512 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-095c0a7c-e99c-4bd5-b756-5760b5cc2baf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:39:58.828959 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-095c0a7c-e99c-4bd5-b756-5760b5cc2baf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:39:58.829378 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-095c0a7c-e99c-4bd5-b756-5760b5cc2baf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:39:58.962121 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-095c0a7c-e99c-4bd5-b756-5760b5cc2baf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:39:58.969777 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-095c0a7c-e99c-4bd5-b756-5760b5cc2baf tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 200 len: 1363 microversion: 2.1 time: 0.156594 Nov 02 07:39:58.970340 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 512/1026] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:58 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:39:59.993314 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-9cce1669-1d94-4e4e-858e-479d21f33f96 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:39:59.993930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-9cce1669-1d94-4e4e-858e-479d21f33f96 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:39:59.995932 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:59.996795 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell0:SELECT=6 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:40:00.003335 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9cce1669-1d94-4e4e-858e-479d21f33f96 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:00.003817 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9cce1669-1d94-4e4e-858e-479d21f33f96 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:00.004253 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9cce1669-1d94-4e4e-858e-479d21f33f96 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:00.004939 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9cce1669-1d94-4e4e-858e-479d21f33f96 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:00.005395 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9cce1669-1d94-4e4e-858e-479d21f33f96 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:00.005999 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9cce1669-1d94-4e4e-858e-479d21f33f96 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:00.138009 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-9cce1669-1d94-4e4e-858e-479d21f33f96 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:40:00.146068 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-9cce1669-1d94-4e4e-858e-479d21f33f96 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 200 len: 1363 microversion: 2.1 time: 0.157179 Nov 02 07:40:00.147369 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 515/1027] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:39:59 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:40:00.930968 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-66c14f3e-eb1e-483d-9d1f-6c061a04aabf req-38e0cc3a-f1c2-455f-8674-acb05a14676a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "babe8edf-10cd-4baf-91c6-a75d694f323e", "name": "network-vif-plugged", "status": "completed", "tag": "7842c2ea-424f-4a73-8ec7-b57ccdf25354"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:40:00.941456 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-66c14f3e-eb1e-483d-9d1f-6c061a04aabf req-38e0cc3a-f1c2-455f-8674-acb05a14676a service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:00.941894 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-66c14f3e-eb1e-483d-9d1f-6c061a04aabf req-38e0cc3a-f1c2-455f-8674-acb05a14676a service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:00.942386 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-66c14f3e-eb1e-483d-9d1f-6c061a04aabf req-38e0cc3a-f1c2-455f-8674-acb05a14676a service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:00.955711 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-66c14f3e-eb1e-483d-9d1f-6c061a04aabf req-38e0cc3a-f1c2-455f-8674-acb05a14676a service nova] Creating event network-vif-plugged:7842c2ea-424f-4a73-8ec7-b57ccdf25354 for instance babe8edf-10cd-4baf-91c6-a75d694f323e on hv-cinder-80473 Nov 02 07:40:00.961345 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-66c14f3e-eb1e-483d-9d1f-6c061a04aabf req-38e0cc3a-f1c2-455f-8674-acb05a14676a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096364 Nov 02 07:40:00.961986 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 513/1028] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:40:01.169203 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-61968eb5-a438-4218-9b41-078d658cf4c8 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:01.169850 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-61968eb5-a438-4218-9b41-078d658cf4c8 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:01.176238 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61968eb5-a438-4218-9b41-078d658cf4c8 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:01.176715 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61968eb5-a438-4218-9b41-078d658cf4c8 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:01.177146 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61968eb5-a438-4218-9b41-078d658cf4c8 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:01.178692 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61968eb5-a438-4218-9b41-078d658cf4c8 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:01.179174 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61968eb5-a438-4218-9b41-078d658cf4c8 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:01.179723 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-61968eb5-a438-4218-9b41-078d658cf4c8 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:01.331870 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-61968eb5-a438-4218-9b41-078d658cf4c8 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:40:01.340458 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-61968eb5-a438-4218-9b41-078d658cf4c8 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 200 len: 1363 microversion: 2.1 time: 0.175179 Nov 02 07:40:01.341020 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 516/1029] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:40:01 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:40:02.363969 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-a94106cc-da1b-497f-938b-55c27c7550f5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:02.364769 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-a94106cc-da1b-497f-938b-55c27c7550f5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:02.371290 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a94106cc-da1b-497f-938b-55c27c7550f5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:02.371879 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a94106cc-da1b-497f-938b-55c27c7550f5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:02.372384 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a94106cc-da1b-497f-938b-55c27c7550f5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:02.373183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a94106cc-da1b-497f-938b-55c27c7550f5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:02.373693 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a94106cc-da1b-497f-938b-55c27c7550f5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:02.374187 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-a94106cc-da1b-497f-938b-55c27c7550f5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:02.507227 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-a94106cc-da1b-497f-938b-55c27c7550f5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:40:02.514894 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-a94106cc-da1b-497f-938b-55c27c7550f5 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 200 len: 1549 microversion: 2.1 time: 0.155648 Nov 02 07:40:02.515455 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 514/1030] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:40:02 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:40:02.539152 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-3cb322c0-d07d-4443-9fa8-856439005c37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:02.539685 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-3cb322c0-d07d-4443-9fa8-856439005c37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:02.545971 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3cb322c0-d07d-4443-9fa8-856439005c37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:02.546491 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3cb322c0-d07d-4443-9fa8-856439005c37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:02.546930 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3cb322c0-d07d-4443-9fa8-856439005c37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:02.547612 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3cb322c0-d07d-4443-9fa8-856439005c37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:02.548063 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3cb322c0-d07d-4443-9fa8-856439005c37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:02.548485 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-3cb322c0-d07d-4443-9fa8-856439005c37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:02.623924 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-3cb322c0-d07d-4443-9fa8-856439005c37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089222 Nov 02 07:40:02.624517 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 517/1031] 10.222.0.18 () {58 vars in 1275 bytes} [Wed Nov 2 07:40:02 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:40:03.603548 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-8e41118c-10ff-4f3b-bcfa-c06d832c1c45 req-cce68078-b38b-413b-94f2-620f19ddf489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "babe8edf-10cd-4baf-91c6-a75d694f323e", "tag": "7842c2ea-424f-4a73-8ec7-b57ccdf25354"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:40:03.613062 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-8e41118c-10ff-4f3b-bcfa-c06d832c1c45 req-cce68078-b38b-413b-94f2-620f19ddf489 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:03.613518 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-8e41118c-10ff-4f3b-bcfa-c06d832c1c45 req-cce68078-b38b-413b-94f2-620f19ddf489 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:03.613946 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-8e41118c-10ff-4f3b-bcfa-c06d832c1c45 req-cce68078-b38b-413b-94f2-620f19ddf489 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:03.618036 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=100 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:40:03.626157 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-8e41118c-10ff-4f3b-bcfa-c06d832c1c45 req-cce68078-b38b-413b-94f2-620f19ddf489 service nova] Creating event network-changed:7842c2ea-424f-4a73-8ec7-b57ccdf25354 for instance babe8edf-10cd-4baf-91c6-a75d694f323e on hv-cinder-80473 Nov 02 07:40:03.631864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-8e41118c-10ff-4f3b-bcfa-c06d832c1c45 req-cce68078-b38b-413b-94f2-620f19ddf489 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090375 Nov 02 07:40:03.632676 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 515/1032] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:40:04.388573 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-fad577e0-bc11-4528-a5cf-a03b9c67e4b3 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:04.389143 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-fad577e0-bc11-4528-a5cf-a03b9c67e4b3 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:04.395480 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fad577e0-bc11-4528-a5cf-a03b9c67e4b3 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:04.395963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fad577e0-bc11-4528-a5cf-a03b9c67e4b3 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:04.397067 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fad577e0-bc11-4528-a5cf-a03b9c67e4b3 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:04.398063 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fad577e0-bc11-4528-a5cf-a03b9c67e4b3 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:04.398564 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fad577e0-bc11-4528-a5cf-a03b9c67e4b3 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:04.398992 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-fad577e0-bc11-4528-a5cf-a03b9c67e4b3 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:04.484680 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.objects.instance [None req-fad577e0-bc11-4528-a5cf-a03b9c67e4b3 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lazy-loading 'services' on Instance uuid 3974cb25-0080-4e8b-bf7a-f037210f594a {{(pid=118991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:40:04.564296 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-fad577e0-bc11-4528-a5cf-a03b9c67e4b3 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a/os-volume_attachments/7ac36788-522d-4994-8fdd-2687e25252e5" status: 202 len: 0 microversion: 2.1 time: 0.179973 Nov 02 07:40:04.565131 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 518/1033] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 07:40:04 2022] DELETE /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a/os-volume_attachments/7ac36788-522d-4994-8fdd-2687e25252e5 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:40:05.701592 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e637a222-6092-49cb-921a-2a2b7625bd58 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:05.702166 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e637a222-6092-49cb-921a-2a2b7625bd58 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:05.709165 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e637a222-6092-49cb-921a-2a2b7625bd58 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:05.709646 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e637a222-6092-49cb-921a-2a2b7625bd58 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:05.710069 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e637a222-6092-49cb-921a-2a2b7625bd58 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:05.710775 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e637a222-6092-49cb-921a-2a2b7625bd58 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:05.711223 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e637a222-6092-49cb-921a-2a2b7625bd58 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:05.711643 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e637a222-6092-49cb-921a-2a2b7625bd58 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:05.738832 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e637a222-6092-49cb-921a-2a2b7625bd58 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Going to try to terminate instance {{(pid=118992) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:40:05.813054 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e637a222-6092-49cb-921a-2a2b7625bd58 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 204 len: 0 microversion: 2.1 time: 0.115023 Nov 02 07:40:05.814019 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 516/1034] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:40:05 2022] DELETE /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:40:05.824345 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-167a31e5-3fe5-4f71-9893-c3ee046b89da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:05.825091 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-167a31e5-3fe5-4f71-9893-c3ee046b89da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:05.833795 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-167a31e5-3fe5-4f71-9893-c3ee046b89da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:05.835191 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-167a31e5-3fe5-4f71-9893-c3ee046b89da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:05.835915 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-167a31e5-3fe5-4f71-9893-c3ee046b89da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:05.836615 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-167a31e5-3fe5-4f71-9893-c3ee046b89da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:05.837071 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-167a31e5-3fe5-4f71-9893-c3ee046b89da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:05.837498 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-167a31e5-3fe5-4f71-9893-c3ee046b89da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:06.000085 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-167a31e5-3fe5-4f71-9893-c3ee046b89da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:40:06.008253 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-167a31e5-3fe5-4f71-9893-c3ee046b89da tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 200 len: 1513 microversion: 2.1 time: 0.188249 Nov 02 07:40:06.009168 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 519/1035] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:40:05 2022] GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:40:07.033847 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ed86dd63-1896-41b4-bc70-c7515422cc22 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:07.034595 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ed86dd63-1896-41b4-bc70-c7515422cc22 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:07.041543 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed86dd63-1896-41b4-bc70-c7515422cc22 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:07.042023 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed86dd63-1896-41b4-bc70-c7515422cc22 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:07.042475 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed86dd63-1896-41b4-bc70-c7515422cc22 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:07.043162 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed86dd63-1896-41b4-bc70-c7515422cc22 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:07.043614 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed86dd63-1896-41b4-bc70-c7515422cc22 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:07.044039 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ed86dd63-1896-41b4-bc70-c7515422cc22 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:07.170536 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-ed86dd63-1896-41b4-bc70-c7515422cc22 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:40:07.178999 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ed86dd63-1896-41b4-bc70-c7515422cc22 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 200 len: 1513 microversion: 2.1 time: 0.149420 Nov 02 07:40:07.179563 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 517/1036] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:40:07 2022] GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:40:08.202299 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-52eac95e-c8fb-450d-b2d8-59e3ef4e4bbc tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:08.202944 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-52eac95e-c8fb-450d-b2d8-59e3ef4e4bbc tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:08.210712 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-52eac95e-c8fb-450d-b2d8-59e3ef4e4bbc tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:08.211190 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-52eac95e-c8fb-450d-b2d8-59e3ef4e4bbc tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:08.211635 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-52eac95e-c8fb-450d-b2d8-59e3ef4e4bbc tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:08.212341 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-52eac95e-c8fb-450d-b2d8-59e3ef4e4bbc tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:08.213167 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-52eac95e-c8fb-450d-b2d8-59e3ef4e4bbc tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:08.215229 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-52eac95e-c8fb-450d-b2d8-59e3ef4e4bbc tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:08.217987 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [req-c634ef0e-ad63-466f-9605-3f98f509eb1f req-a5639569-b55a-43a0-b847-7dca368916cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3974cb25-0080-4e8b-bf7a-f037210f594a", "name": "network-vif-deleted", "tag": "7f4bd317-1cce-4be6-bca0-9d83628ac27d"}]} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:40:08.229395 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c634ef0e-ad63-466f-9605-3f98f509eb1f req-a5639569-b55a-43a0-b847-7dca368916cb service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:08.229884 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c634ef0e-ad63-466f-9605-3f98f509eb1f req-a5639569-b55a-43a0-b847-7dca368916cb service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:08.230320 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [req-c634ef0e-ad63-466f-9605-3f98f509eb1f req-a5639569-b55a-43a0-b847-7dca368916cb service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:08.252925 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.compute.server_external_events [req-c634ef0e-ad63-466f-9605-3f98f509eb1f req-a5639569-b55a-43a0-b847-7dca368916cb service nova] Creating event network-vif-deleted:7f4bd317-1cce-4be6-bca0-9d83628ac27d for instance 3974cb25-0080-4e8b-bf7a-f037210f594a on hv-cinder-80473 Nov 02 07:40:08.258663 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [req-c634ef0e-ad63-466f-9605-3f98f509eb1f req-a5639569-b55a-43a0-b847-7dca368916cb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044188 Nov 02 07:40:08.259263 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 518/1037] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:40:08.283835 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-52eac95e-c8fb-450d-b2d8-59e3ef4e4bbc tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a36d80e845818623cd258a3456fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c30df4815d74ad3a0805a7e0ee259a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:40:08.292773 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-52eac95e-c8fb-450d-b2d8-59e3ef4e4bbc tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 200 len: 1471 microversion: 2.1 time: 0.094308 Nov 02 07:40:08.293355 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 520/1038] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:40:08 2022] GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 1471 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:40:09.318143 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d58b2054-1e6d-4b24-b074-6b4d053c9816 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:09.319469 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-d58b2054-1e6d-4b24-b074-6b4d053c9816 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] [instance: 3974cb25-0080-4e8b-bf7a-f037210f594a] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:09.325517 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d58b2054-1e6d-4b24-b074-6b4d053c9816 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:09.325997 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d58b2054-1e6d-4b24-b074-6b4d053c9816 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:09.326448 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d58b2054-1e6d-4b24-b074-6b4d053c9816 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:09.327134 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d58b2054-1e6d-4b24-b074-6b4d053c9816 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:09.327578 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d58b2054-1e6d-4b24-b074-6b4d053c9816 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:09.327994 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d58b2054-1e6d-4b24-b074-6b4d053c9816 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:09.341098 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-d58b2054-1e6d-4b24-b074-6b4d053c9816 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] HTTP exception thrown: Instance 3974cb25-0080-4e8b-bf7a-f037210f594a could not be found. Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d58b2054-1e6d-4b24-b074-6b4d053c9816 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Request method failure captured: Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a HTTP/1.1 Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYh5y0Lt8CKpLB56IU7fWnLExFXI6xOriVPWw6k7IQ7Ln7cHSvjmtSv4Q5dGL_C5wadvZ_3HvhB2lONwbSMRjiRKyrdm6tT1o2OZgouXMHwdT9zy6pAfWpfsbjnfIAYZQuf44aGV9zFJ-9U_CGq6KWRyXhRfrSK_euqbd2k20XLB_lhQ Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: 5c30df4815d74ad3a0805a7e0ee259a6 Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1536594870 Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:40:09.342721 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:40:09.344304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c30df4815d74ad3a0805a7e0ee259a6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c30df4815d74ad3a0805a7e0ee259a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c30df4815d74ad3a0805a7e0ee259a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c30df4815d74ad3a0805a7e0ee259a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:40:09.344304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-VolumesSnapshotTestJSON-1536594870 Nov 02 07:40:09.344304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: 5c30df4815d74ad3a0805a7e0ee259a6 Nov 02 07:40:09.344304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1536594870 Nov 02 07:40:09.344304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-VolumesSnapshotTestJSON-1536594870-project Nov 02 07:40:09.344304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:40:09.344304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:40:09.344304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 8c67a36d80e845818623cd258a3456fa Nov 02 07:40:09.344304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-VolumesSnapshotTestJSON-1536594870-project Nov 02 07:40:09.344304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:40:09.344304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 3974cb25-0080-4e8b-bf7a-f037210f594a could not be found. Nov 02 07:40:09.344304 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '3974cb25-0080-4e8b-bf7a-f037210f594a'} Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3974cb25-0080-4e8b-bf7a-f037210f594a could not be found. Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:40:09.345233 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3974cb25-0080-4e8b-bf7a-f037210f594a could not be found. Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3974cb25-0080-4e8b-bf7a-f037210f594a could not be found. Nov 02 07:40:09.346761 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:40:09.348104 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d58b2054-1e6d-4b24-b074-6b4d053c9816 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] Returning 404 to user: Instance 3974cb25-0080-4e8b-bf7a-f037210f594a could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:40:09.348104 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-d58b2054-1e6d-4b24-b074-6b4d053c9816 tempest-VolumesSnapshotTestJSON-1536594870 tempest-VolumesSnapshotTestJSON-1536594870-project] 10.222.0.18 "GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a" status: 404 len: 111 microversion: 2.1 time: 0.030821 Nov 02 07:40:09.348104 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 519/1039] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:40:09 2022] GET /compute/v2.1/servers/3974cb25-0080-4e8b-bf7a-f037210f594a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:40:39.506958 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-0dc1f37e-bf4c-47ae-aca1-7b78f8f70df1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:39.507501 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-0dc1f37e-bf4c-47ae-aca1-7b78f8f70df1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:39.509783 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_api:SELECT=19 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:40:39.510477 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG dbcounter [-] [118991] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=2 {{(pid=118991) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:40:39.516871 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0dc1f37e-bf4c-47ae-aca1-7b78f8f70df1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:39.517358 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0dc1f37e-bf4c-47ae-aca1-7b78f8f70df1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:39.518042 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0dc1f37e-bf4c-47ae-aca1-7b78f8f70df1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:39.518752 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0dc1f37e-bf4c-47ae-aca1-7b78f8f70df1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:39.519202 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0dc1f37e-bf4c-47ae-aca1-7b78f8f70df1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:39.519685 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-0dc1f37e-bf4c-47ae-aca1-7b78f8f70df1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:39.543832 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-0dc1f37e-bf4c-47ae-aca1-7b78f8f70df1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/ips" status: 200 len: 145 microversion: 2.1 time: 0.040689 Nov 02 07:40:39.544422 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 521/1040] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 07:40:39 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:40:40.875696 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-4029b118-6e6d-4afe-b442-9df4df92bd70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1f7701d-2791-4a9c-95f5-00d79f7fbf2c"}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:40:40.878116 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-4029b118-6e6d-4afe-b442-9df4df92bd70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:40.880498 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:40:40.881135 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG dbcounter [-] [118992] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:40:40.887353 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4029b118-6e6d-4afe-b442-9df4df92bd70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:40.887828 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4029b118-6e6d-4afe-b442-9df4df92bd70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:40.888778 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4029b118-6e6d-4afe-b442-9df4df92bd70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:40.889459 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4029b118-6e6d-4afe-b442-9df4df92bd70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:40.889906 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4029b118-6e6d-4afe-b442-9df4df92bd70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:40.890322 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4029b118-6e6d-4afe-b442-9df4df92bd70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:41.154257 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-4029b118-6e6d-4afe-b442-9df4df92bd70 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "POST /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281790 Nov 02 07:40:41.154917 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 520/1041] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 07:40:40 2022] POST /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:40:48.689002 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-d2806513-f906-4701-9d92-ccf3adacb82a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:48.691269 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-d2806513-f906-4701-9d92-ccf3adacb82a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:48.697714 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d2806513-f906-4701-9d92-ccf3adacb82a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:48.698191 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d2806513-f906-4701-9d92-ccf3adacb82a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:48.698662 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d2806513-f906-4701-9d92-ccf3adacb82a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:48.699344 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d2806513-f906-4701-9d92-ccf3adacb82a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:48.699796 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d2806513-f906-4701-9d92-ccf3adacb82a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:48.700216 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-d2806513-f906-4701-9d92-ccf3adacb82a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:48.729938 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-d2806513-f906-4701-9d92-ccf3adacb82a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044888 Nov 02 07:40:48.730506 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 522/1042] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 07:40:48 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:40:48.742560 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-edc6651e-a71f-4c37-b004-d146ef81999a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:48.743140 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-edc6651e-a71f-4c37-b004-d146ef81999a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:48.749939 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-edc6651e-a71f-4c37-b004-d146ef81999a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:48.750452 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-edc6651e-a71f-4c37-b004-d146ef81999a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:48.750887 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-edc6651e-a71f-4c37-b004-d146ef81999a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:48.751569 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-edc6651e-a71f-4c37-b004-d146ef81999a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:48.752018 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-edc6651e-a71f-4c37-b004-d146ef81999a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:48.752434 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-edc6651e-a71f-4c37-b004-d146ef81999a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:48.781340 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-edc6651e-a71f-4c37-b004-d146ef81999a tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments/a1f7701d-2791-4a9c-95f5-00d79f7fbf2c" status: 200 len: 194 microversion: 2.1 time: 0.043569 Nov 02 07:40:48.781902 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 521/1043] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Nov 2 07:40:48 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments/a1f7701d-2791-4a9c-95f5-00d79f7fbf2c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:40:50.109592 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-1522f256-5288-4b46-9975-ab3a5f621b5f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b845a177-0cf7-4e91-9379-269d0a42a478"}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:40:50.111987 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-1522f256-5288-4b46-9975-ab3a5f621b5f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:50.118440 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1522f256-5288-4b46-9975-ab3a5f621b5f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:50.118923 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1522f256-5288-4b46-9975-ab3a5f621b5f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:50.119361 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1522f256-5288-4b46-9975-ab3a5f621b5f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:50.120049 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1522f256-5288-4b46-9975-ab3a5f621b5f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:50.120500 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1522f256-5288-4b46-9975-ab3a5f621b5f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:50.120926 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-1522f256-5288-4b46-9975-ab3a5f621b5f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:50.385342 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-1522f256-5288-4b46-9975-ab3a5f621b5f tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "POST /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280283 Nov 02 07:40:50.386069 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 523/1044] 10.222.0.18 () {60 vars in 1323 bytes} [Wed Nov 2 07:40:50 2022] POST /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 07:40:57.916381 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-d46f5a5c-132d-4812-a866-69c8f79c34f1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:57.918631 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-d46f5a5c-132d-4812-a866-69c8f79c34f1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:57.925333 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d46f5a5c-132d-4812-a866-69c8f79c34f1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:57.925819 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d46f5a5c-132d-4812-a866-69c8f79c34f1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:57.926250 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d46f5a5c-132d-4812-a866-69c8f79c34f1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:57.926965 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d46f5a5c-132d-4812-a866-69c8f79c34f1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:57.927419 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d46f5a5c-132d-4812-a866-69c8f79c34f1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:57.927847 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-d46f5a5c-132d-4812-a866-69c8f79c34f1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:57.957534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-d46f5a5c-132d-4812-a866-69c8f79c34f1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045090 Nov 02 07:40:57.958074 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 522/1045] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 07:40:57 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:40:58.097730 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-f6a8ed47-6d0d-4ea0-bf45-e76d17d9e216 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:58.098302 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-f6a8ed47-6d0d-4ea0-bf45-e76d17d9e216 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:58.104477 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6a8ed47-6d0d-4ea0-bf45-e76d17d9e216 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:58.104957 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6a8ed47-6d0d-4ea0-bf45-e76d17d9e216 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:58.105385 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6a8ed47-6d0d-4ea0-bf45-e76d17d9e216 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:58.106060 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6a8ed47-6d0d-4ea0-bf45-e76d17d9e216 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:58.106544 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6a8ed47-6d0d-4ea0-bf45-e76d17d9e216 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:58.106963 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-f6a8ed47-6d0d-4ea0-bf45-e76d17d9e216 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:58.135093 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-f6a8ed47-6d0d-4ea0-bf45-e76d17d9e216 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments/a1f7701d-2791-4a9c-95f5-00d79f7fbf2c" status: 200 len: 194 microversion: 2.1 time: 0.042850 Nov 02 07:40:58.135657 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 524/1046] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Nov 2 07:40:58 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments/a1f7701d-2791-4a9c-95f5-00d79f7fbf2c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:40:58.147033 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2dd3cf0a-8016-47f6-8f32-e2399dbf1b87 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:58.147526 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-2dd3cf0a-8016-47f6-8f32-e2399dbf1b87 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:58.153675 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2dd3cf0a-8016-47f6-8f32-e2399dbf1b87 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:58.154154 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2dd3cf0a-8016-47f6-8f32-e2399dbf1b87 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:58.154616 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2dd3cf0a-8016-47f6-8f32-e2399dbf1b87 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:58.155955 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2dd3cf0a-8016-47f6-8f32-e2399dbf1b87 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:58.156472 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2dd3cf0a-8016-47f6-8f32-e2399dbf1b87 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:58.156895 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2dd3cf0a-8016-47f6-8f32-e2399dbf1b87 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:58.236306 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-2dd3cf0a-8016-47f6-8f32-e2399dbf1b87 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lazy-loading 'services' on Instance uuid babe8edf-10cd-4baf-91c6-a75d694f323e {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:40:58.312149 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-2dd3cf0a-8016-47f6-8f32-e2399dbf1b87 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "DELETE /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments/a1f7701d-2791-4a9c-95f5-00d79f7fbf2c" status: 202 len: 0 microversion: 2.1 time: 0.168052 Nov 02 07:40:58.312729 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 523/1047] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 07:40:58 2022] DELETE /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments/a1f7701d-2791-4a9c-95f5-00d79f7fbf2c => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:40:59.431101 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-9a86173c-5906-4503-919f-d55087679322 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:59.431636 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-9a86173c-5906-4503-919f-d55087679322 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:59.438772 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a86173c-5906-4503-919f-d55087679322 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:59.439247 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a86173c-5906-4503-919f-d55087679322 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:59.439676 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a86173c-5906-4503-919f-d55087679322 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:59.440352 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a86173c-5906-4503-919f-d55087679322 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:59.440886 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a86173c-5906-4503-919f-d55087679322 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:59.441304 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-9a86173c-5906-4503-919f-d55087679322 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:59.470122 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-9a86173c-5906-4503-919f-d55087679322 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments/b845a177-0cf7-4e91-9379-269d0a42a478" status: 200 len: 194 microversion: 2.1 time: 0.042934 Nov 02 07:40:59.470776 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 525/1048] 10.222.0.18 () {58 vars in 1413 bytes} [Wed Nov 2 07:40:59 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments/b845a177-0cf7-4e91-9379-269d0a42a478 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:40:59.481681 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-7b5e63d9-955f-4db3-82ee-e7568d752946 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:40:59.482269 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-7b5e63d9-955f-4db3-82ee-e7568d752946 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:40:59.489423 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b5e63d9-955f-4db3-82ee-e7568d752946 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:59.489903 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b5e63d9-955f-4db3-82ee-e7568d752946 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:59.490339 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b5e63d9-955f-4db3-82ee-e7568d752946 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:59.491060 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b5e63d9-955f-4db3-82ee-e7568d752946 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:40:59.491515 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b5e63d9-955f-4db3-82ee-e7568d752946 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:40:59.491941 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-7b5e63d9-955f-4db3-82ee-e7568d752946 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:40:59.570634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.objects.instance [None req-7b5e63d9-955f-4db3-82ee-e7568d752946 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lazy-loading 'services' on Instance uuid babe8edf-10cd-4baf-91c6-a75d694f323e {{(pid=118992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 07:40:59.641253 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-7b5e63d9-955f-4db3-82ee-e7568d752946 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "DELETE /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments/b845a177-0cf7-4e91-9379-269d0a42a478" status: 202 len: 0 microversion: 2.1 time: 0.163363 Nov 02 07:40:59.641843 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 524/1049] 10.222.0.18 () {58 vars in 1416 bytes} [Wed Nov 2 07:40:59 2022] DELETE /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments/b845a177-0cf7-4e91-9379-269d0a42a478 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:41:00.818046 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-044d192d-7fc4-48a4-90fd-dc90c1833ae6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:41:00.820339 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-044d192d-7fc4-48a4-90fd-dc90c1833ae6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:41:00.827402 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-044d192d-7fc4-48a4-90fd-dc90c1833ae6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:00.827876 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-044d192d-7fc4-48a4-90fd-dc90c1833ae6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:00.828308 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-044d192d-7fc4-48a4-90fd-dc90c1833ae6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:00.828988 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-044d192d-7fc4-48a4-90fd-dc90c1833ae6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:00.829434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-044d192d-7fc4-48a4-90fd-dc90c1833ae6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:00.829851 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-044d192d-7fc4-48a4-90fd-dc90c1833ae6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:00.860794 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-044d192d-7fc4-48a4-90fd-dc90c1833ae6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046836 Nov 02 07:41:00.861333 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 526/1050] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 07:41:00 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 07:41:00.977412 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-97566359-1aea-4057-8c66-3ee9bf5ec202 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:41:00.979679 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-97566359-1aea-4057-8c66-3ee9bf5ec202 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:41:00.987769 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-97566359-1aea-4057-8c66-3ee9bf5ec202 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:00.988250 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-97566359-1aea-4057-8c66-3ee9bf5ec202 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:00.988684 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-97566359-1aea-4057-8c66-3ee9bf5ec202 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:00.989379 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-97566359-1aea-4057-8c66-3ee9bf5ec202 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:00.989831 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-97566359-1aea-4057-8c66-3ee9bf5ec202 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:00.990252 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-97566359-1aea-4057-8c66-3ee9bf5ec202 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:01.021049 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-97566359-1aea-4057-8c66-3ee9bf5ec202 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048361 Nov 02 07:41:01.021610 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 525/1051] 10.222.0.18 () {58 vars in 1302 bytes} [Wed Nov 2 07:41:00 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 07:41:01.083525 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-56f80174-9dc5-4eca-b6ad-34645e3ded37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:41:01.084019 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-56f80174-9dc5-4eca-b6ad-34645e3ded37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:41:01.089879 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-56f80174-9dc5-4eca-b6ad-34645e3ded37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:01.090384 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-56f80174-9dc5-4eca-b6ad-34645e3ded37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:01.090818 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-56f80174-9dc5-4eca-b6ad-34645e3ded37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:01.091500 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-56f80174-9dc5-4eca-b6ad-34645e3ded37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:01.092555 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-56f80174-9dc5-4eca-b6ad-34645e3ded37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:01.093128 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-56f80174-9dc5-4eca-b6ad-34645e3ded37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:01.117186 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-56f80174-9dc5-4eca-b6ad-34645e3ded37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Going to try to terminate instance {{(pid=118991) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 07:41:01.190436 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-56f80174-9dc5-4eca-b6ad-34645e3ded37 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "DELETE /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 204 len: 0 microversion: 2.1 time: 0.110330 Nov 02 07:41:01.190925 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 527/1052] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:41:01 2022] DELETE /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 07:41:01.199345 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-2c691ed1-50ef-485d-b45e-9d46be951b3b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:41:01.199981 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-2c691ed1-50ef-485d-b45e-9d46be951b3b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:41:01.206612 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2c691ed1-50ef-485d-b45e-9d46be951b3b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:01.207091 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2c691ed1-50ef-485d-b45e-9d46be951b3b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:01.207517 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2c691ed1-50ef-485d-b45e-9d46be951b3b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:01.208200 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2c691ed1-50ef-485d-b45e-9d46be951b3b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:01.208648 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2c691ed1-50ef-485d-b45e-9d46be951b3b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:01.209067 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-2c691ed1-50ef-485d-b45e-9d46be951b3b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:01.341949 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-2c691ed1-50ef-485d-b45e-9d46be951b3b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:41:01.349869 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-2c691ed1-50ef-485d-b45e-9d46be951b3b tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 200 len: 1673 microversion: 2.1 time: 0.154691 Nov 02 07:41:01.350440 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 526/1053] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:41:01 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 07:41:02.373809 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-00876218-3161-42c6-980b-410fa7744bd2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:41:02.374566 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-00876218-3161-42c6-980b-410fa7744bd2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:41:02.381092 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-00876218-3161-42c6-980b-410fa7744bd2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:02.381573 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-00876218-3161-42c6-980b-410fa7744bd2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:02.382005 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-00876218-3161-42c6-980b-410fa7744bd2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:02.382723 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-00876218-3161-42c6-980b-410fa7744bd2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:02.383207 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-00876218-3161-42c6-980b-410fa7744bd2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:02.383629 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-00876218-3161-42c6-980b-410fa7744bd2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:02.511560 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.policy [None req-00876218-3161-42c6-980b-410fa7744bd2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118991) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:41:02.520172 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-00876218-3161-42c6-980b-410fa7744bd2 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 200 len: 1673 microversion: 2.1 time: 0.150611 Nov 02 07:41:02.520727 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 528/1054] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:41:02 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:41:03.544683 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-75dbc77a-8cbf-458e-b348-ca32fefb06a1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:41:03.545312 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-75dbc77a-8cbf-458e-b348-ca32fefb06a1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:41:03.552159 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75dbc77a-8cbf-458e-b348-ca32fefb06a1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:03.552553 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75dbc77a-8cbf-458e-b348-ca32fefb06a1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:03.552980 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75dbc77a-8cbf-458e-b348-ca32fefb06a1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:03.553672 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75dbc77a-8cbf-458e-b348-ca32fefb06a1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:03.554126 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75dbc77a-8cbf-458e-b348-ca32fefb06a1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:03.554599 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-75dbc77a-8cbf-458e-b348-ca32fefb06a1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:03.775196 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.policy [None req-75dbc77a-8cbf-458e-b348-ca32fefb06a1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33c63dc278ac4eb79d2a4553fcbeda4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86cca0dcb21a47e483458b36e33f5036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118992) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 07:41:03.783571 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-75dbc77a-8cbf-458e-b348-ca32fefb06a1 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 200 len: 1673 microversion: 2.1 time: 0.243124 Nov 02 07:41:03.784143 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 527/1055] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:41:03 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 1673 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 07:41:04.227418 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [req-d6c5078a-dbae-4a49-97ad-7f12b07f186e req-6c0dc26d-7c8c-4cb5-876e-fcbcbcd8e0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "babe8edf-10cd-4baf-91c6-a75d694f323e", "name": "network-vif-deleted", "tag": "7842c2ea-424f-4a73-8ec7-b57ccdf25354"}]} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:41:04.239084 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-d6c5078a-dbae-4a49-97ad-7f12b07f186e req-6c0dc26d-7c8c-4cb5-876e-fcbcbcd8e0a7 service nova] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:04.239561 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-d6c5078a-dbae-4a49-97ad-7f12b07f186e req-6c0dc26d-7c8c-4cb5-876e-fcbcbcd8e0a7 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:04.239982 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [req-d6c5078a-dbae-4a49-97ad-7f12b07f186e req-6c0dc26d-7c8c-4cb5-876e-fcbcbcd8e0a7 service nova] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:04.251380 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.compute.server_external_events [req-d6c5078a-dbae-4a49-97ad-7f12b07f186e req-6c0dc26d-7c8c-4cb5-876e-fcbcbcd8e0a7 service nova] Creating event network-vif-deleted:7842c2ea-424f-4a73-8ec7-b57ccdf25354 for instance babe8edf-10cd-4baf-91c6-a75d694f323e on hv-cinder-80473 Nov 02 07:41:04.256395 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [req-d6c5078a-dbae-4a49-97ad-7f12b07f186e req-6c0dc26d-7c8c-4cb5-876e-fcbcbcd8e0a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266646 Nov 02 07:41:04.256984 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 529/1056] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Nov 2 07:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 07:41:04.807072 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-4fcfe08e-14e2-4dd9-a840-ee75200681e6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:41:04.807639 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-4fcfe08e-14e2-4dd9-a840-ee75200681e6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:41:04.814447 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4fcfe08e-14e2-4dd9-a840-ee75200681e6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:04.814888 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4fcfe08e-14e2-4dd9-a840-ee75200681e6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:04.815318 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4fcfe08e-14e2-4dd9-a840-ee75200681e6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:04.816021 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4fcfe08e-14e2-4dd9-a840-ee75200681e6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:04.816469 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4fcfe08e-14e2-4dd9-a840-ee75200681e6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:04.816889 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-4fcfe08e-14e2-4dd9-a840-ee75200681e6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:04.833279 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-4fcfe08e-14e2-4dd9-a840-ee75200681e6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] HTTP exception thrown: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-4fcfe08e-14e2-4dd9-a840-ee75200681e6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Request method failure captured: Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e HTTP/1.1 Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYh36LEfeFkt1tDIlX84T3wn87xqb6YMlwASIZ_sY0TYj16_sgpIkQLY4jzIzkLJpoSUQhK0xONGqpapZgqXVlOUKZTbfsiQ4e4AwGntE7eWYiNc3ocCK5E4S09croOCEcYwHOp5UQIQURGSa5kpR5CdEnGecyf-Awbbll8hU3j4eBv8 Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: 86cca0dcb21a47e483458b36e33f5036 Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:41:04.834993 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:41:04.836559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_86cca0dcb21a47e483458b36e33f5036", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:41:04.836559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:41:04.836559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: 86cca0dcb21a47e483458b36e33f5036 Nov 02 07:41:04.836559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:41:04.836559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-AttachVolumeTestJSON-605350857-project Nov 02 07:41:04.836559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:41:04.836559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:41:04.836559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 33c63dc278ac4eb79d2a4553fcbeda4f Nov 02 07:41:04.836559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-AttachVolumeTestJSON-605350857-project Nov 02 07:41:04.836559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:41:04.836559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. Nov 02 07:41:04.836559 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': 'babe8edf-10cd-4baf-91c6-a75d694f323e'} Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:41:04.837360 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. Nov 02 07:41:04.839183 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:04.841985 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-4fcfe08e-14e2-4dd9-a840-ee75200681e6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Returning 404 to user: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:41:04.841985 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-4fcfe08e-14e2-4dd9-a840-ee75200681e6 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 404 len: 111 microversion: 2.1 time: 0.033217 Nov 02 07:41:04.841985 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 528/1057] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:41:04 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:41:04.847670 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-fb888d9a-88f6-4e32-88b6-8d14aebb73dc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '.version_select at 0x7f4d6a5aadc0>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:41:04.868088 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-fb888d9a-88f6-4e32-88b6-8d14aebb73dc tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-621290042" status: 202 len: 0 microversion: 2.1 time: 0.024651 Nov 02 07:41:04.872128 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 530/1058] 10.222.0.18 () {58 vars in 1218 bytes} [Wed Nov 2 07:41:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-621290042 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 07:41:07.754561 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e983a9ea-8e08-424e-99e5-f51b26bf6a10 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:41:07.755091 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-e983a9ea-8e08-424e-99e5-f51b26bf6a10 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:41:07.761407 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e983a9ea-8e08-424e-99e5-f51b26bf6a10 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:07.761891 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e983a9ea-8e08-424e-99e5-f51b26bf6a10 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:07.762325 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e983a9ea-8e08-424e-99e5-f51b26bf6a10 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:07.763240 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e983a9ea-8e08-424e-99e5-f51b26bf6a10 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:07.763711 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e983a9ea-8e08-424e-99e5-f51b26bf6a10 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:07.764141 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-e983a9ea-8e08-424e-99e5-f51b26bf6a10 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:07.777715 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-e983a9ea-8e08-424e-99e5-f51b26bf6a10 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] HTTP exception thrown: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e983a9ea-8e08-424e-99e5-f51b26bf6a10 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Request method failure captured: Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: DELETE /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e HTTP/1.1 Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYh36LEfeFkt1tDIlX84T3wn87xqb6YMlwASIZ_sY0TYj16_sgpIkQLY4jzIzkLJpoSUQhK0xONGqpapZgqXVlOUKZTbfsiQ4e4AwGntE7eWYiNc3ocCK5E4S09croOCEcYwHOp5UQIQURGSa5kpR5CdEnGecyf-Awbbll8hU3j4eBv8 Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: 86cca0dcb21a47e483458b36e33f5036 Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:41:07.779373 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:41:07.780963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_86cca0dcb21a47e483458b36e33f5036", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:41:07.780963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:41:07.780963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: 86cca0dcb21a47e483458b36e33f5036 Nov 02 07:41:07.780963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:41:07.780963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-AttachVolumeTestJSON-605350857-project Nov 02 07:41:07.780963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:41:07.780963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:41:07.780963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 33c63dc278ac4eb79d2a4553fcbeda4f Nov 02 07:41:07.780963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-AttachVolumeTestJSON-605350857-project Nov 02 07:41:07.780963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:41:07.780963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. Nov 02 07:41:07.780963 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': 'babe8edf-10cd-4baf-91c6-a75d694f323e'} Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:41:07.781864 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. Nov 02 07:41:07.783403 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:07.784876 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-e983a9ea-8e08-424e-99e5-f51b26bf6a10 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Returning 404 to user: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:41:07.784876 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-e983a9ea-8e08-424e-99e5-f51b26bf6a10 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "DELETE /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 404 len: 111 microversion: 2.1 time: 0.030242 Nov 02 07:41:07.784876 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 529/1059] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:41:07 2022] DELETE /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:41:07.790818 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-cb55e3a2-e537-4d35-9fc5-14841190918e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:41:07.791553 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-cb55e3a2-e537-4d35-9fc5-14841190918e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: babe8edf-10cd-4baf-91c6-a75d694f323e] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:41:07.799370 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cb55e3a2-e537-4d35-9fc5-14841190918e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:07.799854 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cb55e3a2-e537-4d35-9fc5-14841190918e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:07.800292 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cb55e3a2-e537-4d35-9fc5-14841190918e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:07.800987 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cb55e3a2-e537-4d35-9fc5-14841190918e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:07.801445 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cb55e3a2-e537-4d35-9fc5-14841190918e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:07.801921 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-cb55e3a2-e537-4d35-9fc5-14841190918e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:07.815960 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-cb55e3a2-e537-4d35-9fc5-14841190918e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] HTTP exception thrown: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-cb55e3a2-e537-4d35-9fc5-14841190918e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Request method failure captured: Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e HTTP/1.1 Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYh36LEfeFkt1tDIlX84T3wn87xqb6YMlwASIZ_sY0TYj16_sgpIkQLY4jzIzkLJpoSUQhK0xONGqpapZgqXVlOUKZTbfsiQ4e4AwGntE7eWYiNc3ocCK5E4S09croOCEcYwHOp5UQIQURGSa5kpR5CdEnGecyf-Awbbll8hU3j4eBv8 Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: 86cca0dcb21a47e483458b36e33f5036 Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:41:07.817616 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:41:07.819234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_86cca0dcb21a47e483458b36e33f5036", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:41:07.819234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:41:07.819234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: 86cca0dcb21a47e483458b36e33f5036 Nov 02 07:41:07.819234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:41:07.819234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-AttachVolumeTestJSON-605350857-project Nov 02 07:41:07.819234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:41:07.819234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:41:07.819234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 33c63dc278ac4eb79d2a4553fcbeda4f Nov 02 07:41:07.819234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-AttachVolumeTestJSON-605350857-project Nov 02 07:41:07.819234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:41:07.819234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. Nov 02 07:41:07.819234 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': 'babe8edf-10cd-4baf-91c6-a75d694f323e'} Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:41:07.823313 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. Nov 02 07:41:07.824849 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:07.826899 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-cb55e3a2-e537-4d35-9fc5-14841190918e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Returning 404 to user: Instance babe8edf-10cd-4baf-91c6-a75d694f323e could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:41:07.826899 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-cb55e3a2-e537-4d35-9fc5-14841190918e tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e" status: 404 len: 111 microversion: 2.1 time: 0.032625 Nov 02 07:41:07.826899 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 531/1060] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:41:07 2022] GET /compute/v2.1/servers/babe8edf-10cd-4baf-91c6-a75d694f323e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:41:08.966651 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ff4c6f16-eec6-4e81-b3ce-1db6a1bc6462 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:41:08.967155 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.compute.api [None req-ff4c6f16-eec6-4e81-b3ce-1db6a1bc6462 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118992) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:41:08.973598 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ff4c6f16-eec6-4e81-b3ce-1db6a1bc6462 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:08.974079 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ff4c6f16-eec6-4e81-b3ce-1db6a1bc6462 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:08.974551 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ff4c6f16-eec6-4e81-b3ce-1db6a1bc6462 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:08.975509 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ff4c6f16-eec6-4e81-b3ce-1db6a1bc6462 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:08.975759 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ff4c6f16-eec6-4e81-b3ce-1db6a1bc6462 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:08.976178 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG oslo_concurrency.lockutils [None req-ff4c6f16-eec6-4e81-b3ce-1db6a1bc6462 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:08.991313 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-ff4c6f16-eec6-4e81-b3ce-1db6a1bc6462 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] HTTP exception thrown: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ff4c6f16-eec6-4e81-b3ce-1db6a1bc6462 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Request method failure captured: Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: DELETE /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 HTTP/1.1 Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYh36LEfeFkt1tDIlX84T3wn87xqb6YMlwASIZ_sY0TYj16_sgpIkQLY4jzIzkLJpoSUQhK0xONGqpapZgqXVlOUKZTbfsiQ4e4AwGntE7eWYiNc3ocCK5E4S09croOCEcYwHOp5UQIQURGSa5kpR5CdEnGecyf-Awbbll8hU3j4eBv8 Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: 86cca0dcb21a47e483458b36e33f5036 Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:41:08.992951 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:41:08.994638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_86cca0dcb21a47e483458b36e33f5036", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:41:08.994638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:41:08.994638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: 86cca0dcb21a47e483458b36e33f5036 Nov 02 07:41:08.994638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:41:08.994638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-AttachVolumeTestJSON-605350857-project Nov 02 07:41:08.994638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:41:08.994638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:41:08.994638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 33c63dc278ac4eb79d2a4553fcbeda4f Nov 02 07:41:08.994638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-AttachVolumeTestJSON-605350857-project Nov 02 07:41:08.994638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: > Nov 02 07:41:08.994638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. Nov 02 07:41:08.994638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '954fa08b-6370-4f1b-955f-d3c2efe8ba34'} Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:41:08.995534 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. Nov 02 07:41:08.996770 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:08.998028 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-ff4c6f16-eec6-4e81-b3ce-1db6a1bc6462 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Returning 404 to user: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:41:08.998028 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-ff4c6f16-eec6-4e81-b3ce-1db6a1bc6462 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "DELETE /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 404 len: 111 microversion: 2.1 time: 0.032518 Nov 02 07:41:08.998028 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 530/1061] 10.222.0.18 () {58 vars in 1239 bytes} [Wed Nov 2 07:41:08 2022] DELETE /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:41:09.003036 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-725cf186-206d-4088-9247-638e6e499979 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Calling method '>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:41:09.003675 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.compute.api [None req-725cf186-206d-4088-9247-638e6e499979 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] [instance: 954fa08b-6370-4f1b-955f-d3c2efe8ba34] Fetching instance by UUID {{(pid=118991) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 07:41:09.010296 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-725cf186-206d-4088-9247-638e6e499979 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:09.010857 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-725cf186-206d-4088-9247-638e6e499979 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:09.011315 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-725cf186-206d-4088-9247-638e6e499979 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:09.012011 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-725cf186-206d-4088-9247-638e6e499979 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Acquiring lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 07:41:09.012462 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-725cf186-206d-4088-9247-638e6e499979 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 07:41:09.012912 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG oslo_concurrency.lockutils [None req-725cf186-206d-4088-9247-638e6e499979 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Lock "a592cbfe-d5e4-461b-8a54-ba6eff3d281b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 07:41:09.026560 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-725cf186-206d-4088-9247-638e6e499979 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] HTTP exception thrown: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-725cf186-206d-4088-9247-638e6e499979 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Request method failure captured: Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 HTTP/1.1 Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYh36LEfeFkt1tDIlX84T3wn87xqb6YMlwASIZ_sY0TYj16_sgpIkQLY4jzIzkLJpoSUQhK0xONGqpapZgqXVlOUKZTbfsiQ4e4AwGntE7eWYiNc3ocCK5E4S09croOCEcYwHOp5UQIQURGSa5kpR5CdEnGecyf-Awbbll8hU3j4eBv8 Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: 86cca0dcb21a47e483458b36e33f5036 Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:41:09.028065 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:41:09.030434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_86cca0dcb21a47e483458b36e33f5036", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/86cca0dcb21a47e483458b36e33f5036"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:41:09.030434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:41:09.030434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: 86cca0dcb21a47e483458b36e33f5036 Nov 02 07:41:09.030434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-AttachVolumeTestJSON-605350857 Nov 02 07:41:09.030434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-AttachVolumeTestJSON-605350857-project Nov 02 07:41:09.030434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:41:09.030434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:41:09.030434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 33c63dc278ac4eb79d2a4553fcbeda4f Nov 02 07:41:09.030434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-AttachVolumeTestJSON-605350857-project Nov 02 07:41:09.030434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: > Nov 02 07:41:09.030434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. Nov 02 07:41:09.030434 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': '954fa08b-6370-4f1b-955f-d3c2efe8ba34'} Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:41:09.031294 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. Nov 02 07:41:09.032738 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:09.034070 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-725cf186-206d-4088-9247-638e6e499979 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] Returning 404 to user: Instance 954fa08b-6370-4f1b-955f-d3c2efe8ba34 could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:41:09.034070 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-725cf186-206d-4088-9247-638e6e499979 tempest-AttachVolumeTestJSON-605350857 tempest-AttachVolumeTestJSON-605350857-project] 10.222.0.18 "GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34" status: 404 len: 111 microversion: 2.1 time: 0.030851 Nov 02 07:41:09.034070 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 532/1062] 10.222.0.18 () {58 vars in 1236 bytes} [Wed Nov 2 07:41:08 2022] GET /compute/v2.1/servers/954fa08b-6370-4f1b-955f-d3c2efe8ba34 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 07:41:13.312210 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-4bf65571-74f6-41c3-818a-97e9ad6461b4 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Action: 'create', calling method: .version_select at 0x7f4d6a116700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-346845872", "metadata": {"Type": "work"}}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-4bf65571-74f6-41c3-818a-97e9ad6461b4 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Request method failure captured: Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 121 Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYh8ZQ8aQI8h9i0674qDNE1z-ytoU8bNxKHX1IIz50sCVhjtq8VpEWKEoRVcZ8k59KKrOJaRghK4pavegJFHURTB09LJHdYw-Y2K4PjeDR09bV1nFKuTLN8RqUh8QmS6xLUSY1-66Urf3yWSxTSege-h638HnIS1q2C7I0HZhSHIh3PQ Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: ed115ccc00604c3cb1fb3767d5dd3cec Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:41:13.320008 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:41:13.321732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed115ccc00604c3cb1fb3767d5dd3cec", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:41:13.321732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.321732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: ed115ccc00604c3cb1fb3767d5dd3cec Nov 02 07:41:13.321732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.321732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-VolumesNegativeTest-125174212-project Nov 02 07:41:13.321732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:41:13.321732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:41:13.321732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 7d552d4a32ce45b2be32332103082b49 Nov 02 07:41:13.321732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-VolumesNegativeTest-125174212-project Nov 02 07:41:13.321732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Nov 02 07:41:13.321732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-346845872", "metadata": {"Type": "work"}}} Nov 02 07:41:13.321732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: Nov 02 07:41:13.321732 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-346845872', 'metadata': {'Type': 'work'}}}} Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise error Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi '#$%' Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:41:13.322757 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 07:41:13.325454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 07:41:13.326952 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 07:41:13.326952 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.326952 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-4bf65571-74f6-41c3-818a-97e9ad6461b4 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:41:13.326952 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-4bf65571-74f6-41c3-818a-97e9ad6461b4 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.123665 Nov 02 07:41:13.326952 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 531/1063] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Nov 2 07:41:13 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 07:41:13.332418 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5663ba54-0094-40ec-8d70-11d4ef876c84 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Action: 'create', calling method: .version_select at 0x7f4d6a237430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-148102931", "metadata": {"Type": "work"}}} {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5663ba54-0094-40ec-8d70-11d4ef876c84 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Request method failure captured: Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 119 Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYh8ZQ8aQI8h9i0674qDNE1z-ytoU8bNxKHX1IIz50sCVhjtq8VpEWKEoRVcZ8k59KKrOJaRghK4pavegJFHURTB09LJHdYw-Y2K4PjeDR09bV1nFKuTLN8RqUh8QmS6xLUSY1-66Urf3yWSxTSege-h638HnIS1q2C7I0HZhSHIh3PQ Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: ed115ccc00604c3cb1fb3767d5dd3cec Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:41:13.337126 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:41:13.338669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed115ccc00604c3cb1fb3767d5dd3cec", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:41:13.338669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.338669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: ed115ccc00604c3cb1fb3767d5dd3cec Nov 02 07:41:13.338669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.338669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-VolumesNegativeTest-125174212-project Nov 02 07:41:13.338669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:41:13.338669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:41:13.338669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 7d552d4a32ce45b2be32332103082b49 Nov 02 07:41:13.338669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-VolumesNegativeTest-125174212-project Nov 02 07:41:13.338669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Nov 02 07:41:13.338669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-148102931", "metadata": {"Type": "work"}}} Nov 02 07:41:13.338669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: Nov 02 07:41:13.338669 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-148102931', 'metadata': {'Type': 'work'}}}} Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise error Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi '0' Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:41:13.339488 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 07:41:13.341268 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 07:41:13.342860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 07:41:13.342860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.342860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-5663ba54-0094-40ec-8d70-11d4ef876c84 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:41:13.342860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-5663ba54-0094-40ec-8d70-11d4ef876c84 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009888 Nov 02 07:41:13.342860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 533/1064] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Nov 2 07:41:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 07:41:13.347590 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-24946e27-85a1-4211-893b-a163af507ec4 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Action: 'create', calling method: .version_select at 0x7f4d6a391e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1592258761", "metadata": {"Type": "work"}}} {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-24946e27-85a1-4211-893b-a163af507ec4 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Request method failure captured: Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 119 Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYh8ZQ8aQI8h9i0674qDNE1z-ytoU8bNxKHX1IIz50sCVhjtq8VpEWKEoRVcZ8k59KKrOJaRghK4pavegJFHURTB09LJHdYw-Y2K4PjeDR09bV1nFKuTLN8RqUh8QmS6xLUSY1-66Urf3yWSxTSege-h638HnIS1q2C7I0HZhSHIh3PQ Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: ed115ccc00604c3cb1fb3767d5dd3cec Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:41:13.352309 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:41:13.353937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed115ccc00604c3cb1fb3767d5dd3cec", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:41:13.353937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.353937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: ed115ccc00604c3cb1fb3767d5dd3cec Nov 02 07:41:13.353937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.353937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-VolumesNegativeTest-125174212-project Nov 02 07:41:13.353937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:41:13.353937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:41:13.353937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 7d552d4a32ce45b2be32332103082b49 Nov 02 07:41:13.353937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-VolumesNegativeTest-125174212-project Nov 02 07:41:13.353937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Nov 02 07:41:13.353937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1592258761", "metadata": {"Type": "work"}}} Nov 02 07:41:13.353937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: Nov 02 07:41:13.353937 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1592258761', 'metadata': {'Type': 'work'}}}} Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise error Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi '' Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:41:13.354973 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 07:41:13.357103 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 07:41:13.358638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 07:41:13.358638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.358638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-24946e27-85a1-4211-893b-a163af507ec4 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:41:13.358638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-24946e27-85a1-4211-893b-a163af507ec4 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009868 Nov 02 07:41:13.358638 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 532/1065] 10.222.0.18 () {60 vars in 1156 bytes} [Wed Nov 2 07:41:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 07:41:13.363892 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-793da89b-3602-4d0d-900e-30e9b6a274fd tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Calling method '.version_select at 0x7f4d6a457c10>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:41:13.394104 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-793da89b-3602-4d0d-900e-30e9b6a274fd tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] HTTP exception thrown: Volume tempest-invalid-555998004 could not be found. Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-793da89b-3602-4d0d-900e-30e9b6a274fd tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Request method failure captured: Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-555998004 HTTP/1.1 Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYh8ZQ8aQI8h9i0674qDNE1z-ytoU8bNxKHX1IIz50sCVhjtq8VpEWKEoRVcZ8k59KKrOJaRghK4pavegJFHURTB09LJHdYw-Y2K4PjeDR09bV1nFKuTLN8RqUh8QmS6xLUSY1-66Urf3yWSxTSege-h638HnIS1q2C7I0HZhSHIh3PQ Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: ed115ccc00604c3cb1fb3767d5dd3cec Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:41:13.396082 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:41:13.397860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed115ccc00604c3cb1fb3767d5dd3cec", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:41:13.397860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.397860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: ed115ccc00604c3cb1fb3767d5dd3cec Nov 02 07:41:13.397860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.397860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-VolumesNegativeTest-125174212-project Nov 02 07:41:13.397860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:41:13.397860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:41:13.397860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 7d552d4a32ce45b2be32332103082b49 Nov 02 07:41:13.397860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-VolumesNegativeTest-125174212-project Nov 02 07:41:13.397860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: Nov 02 07:41:13.397860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Volume tempest-invalid-555998004 could not be found. Nov 02 07:41:13.397860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': 'tempest-invalid-555998004'} Nov 02 07:41:13.397860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-555998004 could not be found. (HTTP 404) (Request-ID: req-81bf1bc4-1d2c-4e5a-8e96-b2710c06fbde) Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:13.398985 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 07:41:13.400614 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-555998004 could not be found. Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:41:13.402568 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-555998004 could not be found. Nov 02 07:41:13.404177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.404177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:13.404177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.404177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.404177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:13.404177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:13.404177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:41:13.404177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:41:13.404177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-555998004 could not be found. Nov 02 07:41:13.404177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.404177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-793da89b-3602-4d0d-900e-30e9b6a274fd tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Returning 404 to user: Volume tempest-invalid-555998004 could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:41:13.404177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-793da89b-3602-4d0d-900e-30e9b6a274fd tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-555998004" status: 404 len: 98 microversion: 2.1 time: 0.039083 Nov 02 07:41:13.404177 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 534/1066] 10.222.0.18 () {58 vars in 1215 bytes} [Wed Nov 2 07:41:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-555998004 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 07:41:13.408087 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-cce0e451-6826-489a-85cd-d6756be042f9 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003793 Nov 02 07:41:13.408595 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 533/1067] 10.222.0.18 () {58 vars in 1140 bytes} [Wed Nov 2 07:41:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 02 07:41:13.416611 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-4f20596a-1598-493b-8d17-710f43e70bac tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003663 Nov 02 07:41:13.417085 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 535/1068] 10.222.0.18 () {58 vars in 1137 bytes} [Wed Nov 2 07:41:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 07:41:13.425307 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0020a47c-60b6-4b26-9045-2b8a65542347 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Calling method '.version_select at 0x7f4d6a5f04c0>' {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:41:13.453454 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.wsgi [None req-0020a47c-60b6-4b26-9045-2b8a65542347 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] HTTP exception thrown: Volume 929d29b4-8a56-4ba1-b565-ce44f34aa927 could not be found. Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0020a47c-60b6-4b26-9045-2b8a65542347 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Request method failure captured: Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: request: DELETE /compute/v2.1/os-volumes/929d29b4-8a56-4ba1-b565-ce44f34aa927 HTTP/1.1 Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept: application/json Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Accept-Encoding: identity Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Connection: close Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Length: 0 Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Content-Type: application/json Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Host: 10.222.0.18 Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: Openstack-System-Scope: None Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: User-Agent: python-urllib3/1.26.12 Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Auth-Token: gAAAAABjYh8ZQ8aQI8h9i0674qDNE1z-ytoU8bNxKHX1IIz50sCVhjtq8VpEWKEoRVcZ8k59KKrOJaRghK4pavegJFHURTB09LJHdYw-Y2K4PjeDR09bV1nFKuTLN8RqUh8QmS6xLUSY1-66Urf3yWSxTSege-h638HnIS1q2C7I0HZhSHIh3PQ Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Id: None Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Domain-Name: None Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Identity-Status: Confirmed Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Is-Admin-Project: True Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Id: default Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Domain-Name: Default Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Id: ed115ccc00604c3cb1fb3767d5dd3cec Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Project-Name: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Role: member,reader Nov 02 07:41:13.455634 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Roles: member,reader Nov 02 07:41:13.458739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed115ccc00604c3cb1fb3767d5dd3cec", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:41:13.458739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.458739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Id: ed115ccc00604c3cb1fb3767d5dd3cec Nov 02 07:41:13.458739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-Tenant-Name: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.458739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User: tempest-VolumesNegativeTest-125174212-project Nov 02 07:41:13.458739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Id: default Nov 02 07:41:13.458739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Domain-Name: Default Nov 02 07:41:13.458739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Id: 7d552d4a32ce45b2be32332103082b49 Nov 02 07:41:13.458739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: X-User-Name: tempest-VolumesNegativeTest-125174212-project Nov 02 07:41:13.458739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: method: Nov 02 07:41:13.458739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: exception: Volume 929d29b4-8a56-4ba1-b565-ce44f34aa927 could not be found. Nov 02 07:41:13.458739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: action_args: {'id': '929d29b4-8a56-4ba1-b565-ce44f34aa927'} Nov 02 07:41:13.458739 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: {{(pid=118992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 929d29b4-8a56-4ba1-b565-ce44f34aa927 could not be found. (HTTP 404) (Request-ID: req-5874c5d4-4539-4db0-b276-2b4c8553f1b9) Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:13.459744 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 07:41:13.460921 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 929d29b4-8a56-4ba1-b565-ce44f34aa927 could not be found. Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 07:41:13.462167 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:41:13.463751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 929d29b4-8a56-4ba1-b565-ce44f34aa927 could not be found. Nov 02 07:41:13.463751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.463751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:13.463751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.463751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.463751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:13.463751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:13.463751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:41:13.463751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:41:13.463751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 929d29b4-8a56-4ba1-b565-ce44f34aa927 could not be found. Nov 02 07:41:13.463751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.463751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: DEBUG nova.api.openstack.wsgi [None req-0020a47c-60b6-4b26-9045-2b8a65542347 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Returning 404 to user: Volume 929d29b4-8a56-4ba1-b565-ce44f34aa927 could not be found. {{(pid=118992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:41:13.463751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: INFO nova.api.openstack.requestlog [None req-0020a47c-60b6-4b26-9045-2b8a65542347 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/929d29b4-8a56-4ba1-b565-ce44f34aa927" status: 404 len: 109 microversion: 2.1 time: 0.035876 Nov 02 07:41:13.463751 dv-cinder-804735-33-iscsi devstack@n-api.service[118992]: [pid: 118992|app: 0|req: 534/1069] 10.222.0.18 () {58 vars in 1248 bytes} [Wed Nov 2 07:41:13 2022] DELETE /compute/v2.1/os-volumes/929d29b4-8a56-4ba1-b565-ce44f34aa927 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 07:41:13.468243 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-46a01d2d-a69f-4b61-8e70-6aeba3d9bd03 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Calling method '.version_select at 0x7f4d6a413550>' {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 07:41:13.496230 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.wsgi [None req-46a01d2d-a69f-4b61-8e70-6aeba3d9bd03 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] HTTP exception thrown: Volume ce083c31-02c0-40a4-b552-4729c540f4f0 could not be found. Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-46a01d2d-a69f-4b61-8e70-6aeba3d9bd03 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Request method failure captured: Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: request: GET /compute/v2.1/os-volumes/ce083c31-02c0-40a4-b552-4729c540f4f0 HTTP/1.1 Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept: application/json Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Accept-Encoding: identity Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Connection: close Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Length: 0 Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Content-Type: application/json Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Host: 10.222.0.18 Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: Openstack-System-Scope: None Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: User-Agent: python-urllib3/1.26.12 Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Auth-Token: gAAAAABjYh8ZQ8aQI8h9i0674qDNE1z-ytoU8bNxKHX1IIz50sCVhjtq8VpEWKEoRVcZ8k59KKrOJaRghK4pavegJFHURTB09LJHdYw-Y2K4PjeDR09bV1nFKuTLN8RqUh8QmS6xLUSY1-66Urf3yWSxTSege-h638HnIS1q2C7I0HZhSHIh3PQ Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Id: None Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Domain-Name: None Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Identity-Status: Confirmed Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Is-Admin-Project: True Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Id: default Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Domain-Name: Default Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Id: ed115ccc00604c3cb1fb3767d5dd3cec Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Project-Name: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Role: member,reader Nov 02 07:41:13.498246 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Roles: member,reader Nov 02 07:41:13.499860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed115ccc00604c3cb1fb3767d5dd3cec", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed115ccc00604c3cb1fb3767d5dd3cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Nov 02 07:41:13.499860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.499860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Id: ed115ccc00604c3cb1fb3767d5dd3cec Nov 02 07:41:13.499860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-Tenant-Name: tempest-VolumesNegativeTest-125174212 Nov 02 07:41:13.499860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User: tempest-VolumesNegativeTest-125174212-project Nov 02 07:41:13.499860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Id: default Nov 02 07:41:13.499860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Domain-Name: Default Nov 02 07:41:13.499860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Id: 7d552d4a32ce45b2be32332103082b49 Nov 02 07:41:13.499860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: X-User-Name: tempest-VolumesNegativeTest-125174212-project Nov 02 07:41:13.499860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: method: Nov 02 07:41:13.499860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: exception: Volume ce083c31-02c0-40a4-b552-4729c540f4f0 could not be found. Nov 02 07:41:13.499860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: action_args: {'id': 'ce083c31-02c0-40a4-b552-4729c540f4f0'} Nov 02 07:41:13.499860 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: {{(pid=118991) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce083c31-02c0-40a4-b552-4729c540f4f0 could not be found. (HTTP 404) (Request-ID: req-95137aad-b7df-46a6-a586-0e6479c99217) Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:13.500843 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 07:41:13.502424 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce083c31-02c0-40a4-b552-4729c540f4f0 could not be found. Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 07:41:13.503955 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 07:41:13.505382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce083c31-02c0-40a4-b552-4729c540f4f0 could not be found. Nov 02 07:41:13.505382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.505382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 07:41:13.505382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.505382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 07:41:13.505382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 07:41:13.505382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 07:41:13.505382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 07:41:13.505382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 07:41:13.505382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce083c31-02c0-40a4-b552-4729c540f4f0 could not be found. Nov 02 07:41:13.505382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: ERROR nova.api.openstack.wsgi Nov 02 07:41:13.505382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: DEBUG nova.api.openstack.wsgi [None req-46a01d2d-a69f-4b61-8e70-6aeba3d9bd03 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] Returning 404 to user: Volume ce083c31-02c0-40a4-b552-4729c540f4f0 could not be found. {{(pid=118991) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 07:41:13.505382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: INFO nova.api.openstack.requestlog [None req-46a01d2d-a69f-4b61-8e70-6aeba3d9bd03 tempest-VolumesNegativeTest-125174212 tempest-VolumesNegativeTest-125174212-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/ce083c31-02c0-40a4-b552-4729c540f4f0" status: 404 len: 109 microversion: 2.1 time: 0.035860 Nov 02 07:41:13.505382 dv-cinder-804735-33-iscsi devstack@n-api.service[118991]: [pid: 118991|app: 0|req: 536/1070] 10.222.0.18 () {58 vars in 1245 bytes} [Wed Nov 2 07:41:13 2022] GET /compute/v2.1/os-volumes/ce083c31-02c0-40a4-b552-4729c540f4f0 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)